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Abstract. We express the /-^-multiplicities of a representation of the discrete 
series associated to a coadjoint orbit O in terms of Spin c -index on symplectic 
reductions of O. 
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1. Introduction and statement of the results 

The purpose of this paper is to show that the ' quantization commutes with re- 
duction' principle of Guillemin-Sternberg |l6| ] holds for the coadjoint orbits that 
parametrize the discrete series of a real connected semi-simple Lie group. 

1.1. Discrete series and ^-multiplicities. Let G be a connected, real, semisim- 
ple Lie group with finite center. By definition, the discrete series of G is the set 
of isomorphism classes of irreducible, square integrable, unitary representations of 
G. Let K be a maximal compact subgroup of G, and T be a maximal torus in K. 
Harish-Chandra has shown that G has a discrete series if and only if T is a Cartan 
subgroup of G jl9| ]. For the remainder of this paper, we may therefore assume that 
T is a Cartan subgroup of G. 

Let us fix some notation. We denote by g, t, f the Lie algebras of G, K, T, and 
by Q*,t*,t* their duals. Let A* C t* be the set of real weights: a e A* if ia is the 
differential of a character of T. Let 9\ c C SK C A* be respectively the set of roots 

Keywords : moment map, reduction, geometric quantization, discrete series, transversally 
elliptic symbol. 
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for the action of T on t <g> C and g (g) C. We choose a system of positive roots 
for d\ c . We denote by tl the corresponding Weyl chamber, and we let p c be half 
the sum of the elements of 9^+. The set := A* n i* + parametrizes the unitary 
dual of K . For [i G A+, let x K be the character of the irreducible if -representation 
with highest weight p. 

Harish- Chandra parametrizes the discrete series by a discrete subset Gd of regu- 
lar elements of the Weyl chamber t*j_ [jl9| . He associates to any A S Gd an invariant 
eigendistribution on G, denoted by 6a, which is shown to be the global trace of an 
irreducible, square integrable, unitary representation 7i\ of G. It is a generalized 
function on G, invariant by conjugation, which admits a restriction to K denoted 
by Q\\k- The distribution <d\ \k corresponds to the global trace of the induced 
representation of K on H\ . It admits a decomposition 

Qx\k= J2 nv(A) X « , 

where the integers m /J (A) satisfy certain combinatorial identities called the Blattner 
formulas pof . 

The main goal of the paper is to relate the multiplicities m M (A) to the geometry 
of the coadjoint orbit G ■ A C g* as predicted by the Guillemin- Sternberg principle 
evoked above. 

Before stating our result we recall how a representation belonging to the discrete 
series can be realized as the quantization of a coadjoint orbit. 

1.2. Realisation of the discrete series. In the 60's, Kostant and Langlands 
conjectured realisations of the discrete series in terms of L 2 cohomology that fit 
into the general framework of quantization. The proof of this conjecture was given 
by Schmid somes years later |34|, p5| . Let us recall the procedure for a fixed A 6 Gd- 
The manifold G ■ A carries several G-invariant complex structures. For con- 
venience we work with the complex structure J defined by the following condi- 
tion: each weight a for the T-action on the tangent space (Ta(G - A), J) satisfies 
(a, A) > 0. 

Let £H + C £H be the set of positive roots defined by A: a G 5H + (a, A) > 0. 
Let p be half the sum of the elements of fH + . The condition A G Gd imposes that 
A — p is a weight for T, so we can consider the line bundle 

L:=Gx T C A -p 

over G • A ~ G/T: this line bundle carries a canonical holomorphic structure. Let 
fi fe (L) be the space of L-valued (0, k) forms on G • A, and di : Vt k {L) — > fl k+1 (L) 
be the Dolbeault operator. The choice of G-invariant hermitian metrics on G ■ A 
and on L give meaning to the formal adjoint di of the c?£ operator, and to the 
Dolbeault-Dirac operator + di- 

The L 2 cohomology of L, which we denote by H( 2 ) (G • A, L) , is equal to the kernel 

of the differential operator + di acting on the subspace of Q* (Z) formed by the 
square integrable elements. 

Theorem 1.1. (Schmid). 
Let A G G d - 

fzjHf 2) (G.A,L) = 0z/M^?^. 
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(ii) If k = dlm (^/- ft ") ; then H? 2 )(G • A, L) is the irreducible representation TC\. 

So, the representation TL\ is the quantization of the coadjoint orbit G ■ A beeing 
the index of the Dolbeault-Dirac operator &i + di (in the L 2 sense and modulo 
(— 1) ( 2 1 ). In the next subsection, we briefly recall the 'quantization commutes 



with reduction' principle of Guillcmin- Sternberg, and in subsection LA we state our 
main result. 

1.3. Quantization commutes with reduction. Let M be a Hamiltonian K- 
manifold with symplectic form w and moment map $ : M — ► t*. The coadjoint 
orbits G ■ A introduced earlier are the key examples here. Each is equipped with 
its Kirillov-Kostant-Souriau symplectic form w, and the action of G is Hamiltonian 
with moment map G- A g* equal to the inclusion. Let K be the maximal compact 



Lie subgroup of G introduced in subsection 1.2. The induced action of K on G ■ A 
is Hamiltonian, and the corresponding moment map $ : G ■ A — > i* is equal to the 
composition of the inclusion G ■ A <— > g* with the projection g* — > £*. 

In the process of quantization one tries to associate a unitary representation of 
K to the data (M,oj, $). In this general framework, when M is compact and under 
certain integrability conditions, we associate to these data a virtual representation 
of K defined as the equivariant index of a Spin c Dirac operator: it's the Spin c 
quantization. We need two auxilliary data : 

(i) A prequantum line bundle L — > M: it is a iiT-equivariant Hermitian line 
bundle equipped with if-invariant connection whose curvature form is — iuj. 

(ii) A if-invariant almost complex structure J on M, compatible with the sym- 
plectic structure: (v, w) t— > u>(v, Jw) defines a metric. 

One considers then the i^-equivariant Spin c Dirac operator Dl corresponding 
to the Spin c structure on M defined by J, and twisted by the line bundle L [^5| 
pT| . The Spin c -quantization of (M,u>, <1>) is the equivariant index of the differential 
operator Vl 

RR K (M, L) := Index^(Di) G R{K) , 

where R(K) is the representation ring of K. When K is reduced to {e}, the Spin c - 
quantization of {M , uj) is just an integer: RR(M, L) G Z. 

A fundamental result of Marsden-Weinstein asserts that if £ G 6* is a regular 
value of the moment map $, the reduced space 

M i :=*- 1 (0/iT C S$- 1 (if 

is an orbifold equipped with a symplectic structure (which one calls also sym- 
plectic quotient). For any dominant weight fi G A!j_ which is a regular value of 

is a prequantum orbifold- line bundle over (M M ,w M ). The definition of Spin c -index 
carries over to the orbifold case, hence RR{M ll ,L IJ ) £ Z is defined. In [^9], this 
is extended further to the case of singular symplectic quotients, using partial (or 
shift) desingularization. So the integer RR(M^, L M ) G Z is well defined for every 
It G A* . 

The following Theorem was conjectured by Guillemin-Sternberg and is known 
as "quantization commutes with reduction" pq, E9] . 
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Theorem 1.2. (Meinrenken, Meinrenken-Sjamaar). Let (M, u), $) be a compact 
Hamiltonian K-manifold prequantized by L. Let RR (M, — ) be the equivariant 
Riemann-Roch character defined by means of a compatible almost complex structure 
on M . We have the following equality in R{K) 

RR K (M, L) = RR(M^L^ X « • 

fj,eA* + 

Remark 1.3. For a compact Hamiltonian K-manifold (M, u>, $) ; the Convexity 
Theorem |23fl asserts that A := $(Af)nt^ is a convex rational poly tope. In Theorem 



11, we have RR(M ll , L^) = if /i <£ A. 



Other proofs can be found in 1 33 , 4(J • For an introduction and further references 
see @ g. 

A natural question is to extend Theorem 1.2 to the non- compact Hamiltonian 
if -manifolds which admit a proper moment map. In this situation, the reduced 
space Mj := $ _1 (£)/A£ is compact for every £ G t* , so the integer RR(M fJi , L M ) G 
Z, fi 6 Al, can be defined like before. 

Conjecture 1.4. Let (M,uj, $) be a Hamiltonian K-manifold with proper moment 
map, and prequantized by L. Let 8l + d L be the Dolbeault-Dirac operator defined 
by means of a K -invariant compatible almost complex structure, and K -invariant 
metric on M and L. Then 

L 2 - Index- (d L + d* L ) = Y, RR ( M ^ L »)X« ■ 

We present in the next subsection the central result of this paper that shows 
that Conjecture 1.4 is true, apart from a p c -shift, for the coadjoint orbits that 
parametrize the discrete series. 

1.4. The results. Consider the Hamiltonian action of K on the coadjoint orbit 
G ■ A. Since G ■ A is closed in g*, the moment map $ : G ■ A — > t* is proper Our 
main Theorem can be stated roughly as follows. 

Theorem 1.5. Let m M (A),/i G Ai_, be the K -multiplicities of the representation 
T~i\\i<- For /i G A^ we have: 

(i) If /i + p c is a regular value of <i>, the orbifold (G ■ A) M -fp c :— $ (/z + p c )/T, 
oriented by its symplectic form uj )1+Pc , carries a Spin c structure such that 

m M (A) = fi((G-AW) , 

where the RHS is the index of the corresponding Spin c Dirac operator on the reduced 
space (G ■ A) M+Pc . 

(ii) In general, one can define an integer Q ((G • A) M+Pc ) G Z, as the index of a 
Spin c Dirac operator on a reduced space (G ■ A)^ where £ is a regular value of $, 
close enough to /i + p c . We still have m p (A) = Q (A/ M+(9e ). 

Our Theorem states that the decomposition of Oa|x into A- irreducible compo- 
nents follows the philosophy of Guillcmin-Sternberg: 

(i) e x \ K = Q((G-AW) X : ■ 
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We know from Theorem 1.1 that Q\\k = ( — 1) 2 ' L 2 — Index A {dj +d\), hence 



Theorem 1.5 states also that 

(2) L 2 - Index- (9 z +al) = (-l)^ m V Q ((G ■ X), +Pc ) xl 



fj,eA*, 



The main difference between Conjecture |1.4| and Theorem |1.5| is the p c -shift and 
the choices of Spin c structure on the symplectic quotients M p and (G ■ X) fl+Pc . 

The p c -shift is due to the fact that the line bundle L is not a prequantum line 
bundle over (G ■ A,w). The difference on the choice of Spin c structure comes from 
the fact that the complex structure J on G ■ A is not compatible with the symplectic 
structure (unless G = K is compact). Hence J does not descend to the symplectic 
reductions (G • A) Al + Pc in general: the choice of the Spin c structure on them need 
some care (see Propositions 4. 10| and |4. 1 1 ) . 



Remark 1.6. For a Hamiltonian K -manifold M with proper moment map $, the 
Convexity Theorem ]23| , |26[ |38| asserts that A := $(M) n t+ is a convex rational 
polyhedron. In Theorem uTa , we have Q((G ■ A) A1+Pc ) = if /i + p c does not belong 
to the relative interior of A (see Prop. \2.^) . 

1.5. Outline of the Proof. We have to face the following difficulties: 
[1] The symplectic manifold G • A is not compact. 

[2] The complex structure on G • A is not compatible with the symplectic form 
to. In other words, the Kirillov-Kostant-Souriau symplectic form does not define a 
Kahler structure on G ■ A unless G = K is compact. 

[3] The line bundle L is not a prequantum line bundle over (G • X,ui). It's what 
we call in the rest of this paper a k- prequantum^ line bundle over (G • X,u>, J): if 
k denotes the canonical line bundle of (G • A, J), the tensor product L? ® k~ x is a 
prequantum line bundle over (G • A, 2uj). 

The first step of the proof is to solve the difficulties [2] and [3] in the compact 
situation. In Section |L we give a modified version of Theorem [h^ when (M, oj, $) 
is a compact Hamiltonian X-manifold which is equipped with an almost complex 
structure J - not necessarily compatible with oj - and a K-prequantum line bundle 
L. 

Theorem 1.7. Let RR (Af, — ) be the Riemann-Roch character defined by J. If 
the infinitesimal stabilizers for the action of K on M are Abelian, we have 

(3) RR K (M, L)=eV] Q(M P+Pc ) X K U , 



fj,eA* 



+ 



where e = ±1 is the 'quotient' of the orientations induced by the almost complex 
structure, and the symplectic form. 



In (3), the integer Q(M fJ-+Pc ) are computed like in Theorem L5 (see Def. 2A for 
a more precise definition). 

In the second step of the proof, we extend (3) to a non-compact setting. Instead 
of working with the L 2 -Index, we define in Section |^ a generalized Riemann-Roch 
character RR^(M, — ) when (M, $) is a Hamiltonian manifold such that the 



^Formally, L is the tensor product of a prequantum line bundle over (G • A, uj) with a square 
root of re. 
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function || $ || 2 : M — > R has a compact set of critical points. For every if- 
vector bundle E — > M, the distribution RR^(A1,E) is defined as the index of a 
transversally elliptic operator on M Q|. When the manifold is compact, the maps 
RR% (M, -) and (M, -) coincide. 



We prove in Section M that Theorem 1.7 generalizes to 



Theorem 1.8. Let {M, to, $) fee a Hamiltonian K-manifold with proper moment 
map and such that the function || $ || 2 : M — > R /ias a compact set of critical points. 



If the infinitesimal stabilizers are Abelian, and under Assumption 3.t, we have 



(4) RRl (M, L)=eJ2 Q( M ^+Pa ) < , 

for every n-prequantum line bundle. 

In contrast to (3), the RHS of (4) is in general an infinite sum. Assumption 



3.6 is needed to control the data on the non-compact manifold M: it asserts in 
particular that for any coadjoint orbit O of K, the square of the moment map 
<£>e> : M X O -> f , (m, £) i— ► $(m) — £, has a compact set of critical points. 

In the final section we consider, for X E Gd, the case of the coadjoint orbit G ■ X 
with the Hamiltonian X-action. The moment map $ is proper and the critical set 
of || $ || 2 coincides with K ■ A, hence is compact. Thus the generalized Riemann- 
Roch character RR$ (G ■ A, — ) is well defined, and we want to investigate the index 
RR$(M, L) for the K-prequantum line bundle L := G x T C\- p . 

On one hand we are able to compute (G ■ A, L) explicitly in term of the 

K 

holomorphic induction map Hol T . Let p be the orthogonal complement of tin g. It 
inherits a complex structure and an action of the torus T. The element A*p £ R(T) 
admits a polarized inverse [Ajp]^ 1 £ R-°°(T) (see p§ [Section 5]). In Subsection 



5.2 we prove that 

(5) RRl(G-X,L) = (-l)* 21 ^!^ (f-P'+P* [Ajp]- 1 ) , 

where p n — p — p c is half the sum of the non-compact roots. On the other hand, we 
show (Lemma ^J) that the Blattner formulas can be reinterpreted through Hol T 
as follows: 

(6) 6x|k = HoC (V-"^" [Ajp]- 1 " 



From (5) and (6) we obtain 
(7) RrI{G-X,L) 
Since in this context e = (— 1) ^ ' ' , the Theorem follows from (4) and (7), 



(7) RRl{G-X,L) = (-l) d ' m( ? /K) Q X \ K = L 2 - Indcx K (c> £ +d\). 



provided one verifies that Assumption 3.6 holds for G ■ X. This is done in the final 
subsection of this paper. 

Acknowledgments. I would like to thank Michele Vergne for suggesting this 
problem, and helpful discussions. 
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Throughout the paper, K will denote a compact, connected Lie group, and 6 
its Lie algebra. In Sections 2, 3, and 4, we consider a if-Hamiltonian action on a 
manifold M. And we use there the following notation. 

T : maximal torus of K with Lie algebra t 
W : Weyl group of (K, T) 
A = kcr(cxp : t — > T) : integral lattice of t 
A* = hom(A, 2-7rZ) : real weight lattice 

i* +1 p c '■ Weyl chamber and corresponding half sum of the positive roots 
A+ = A* n t+ : set of positive weights 

X K '■ character of the irreducible /^-representation with highest weight 

/<= A; 

Tg : subtorus of T generated by (3 € t 
M 7 : submanifold of points fixed by 7 G fi 
TM : tangent bundle of M 

TjfM : set of tangent vectors orthogonal to the if-orbits in M 

$ : moment map 

L : K-prequantum line bundle 

C[ M ] = K Xt C m : K-prequantum line bundle over the coadjoint orbit K ■ 

(P + Pc) 

Cr(|| $ || 2 ) : critical set of the function || $ || 2 
A = $(M) n t+ : moment polytope 
H : vector field generated by $ 

m^(E) : multiplicity of RR^(M,E) relatively to p g A+. 
In the final section, we consider the particular case of the if-action on M := G-X. 
Here G is a connected real semi-simple Lie group with finite center admitting K as 
a maximal compact subgroup, and T as a compact Cartan subgroup. 

K 

Let us recall the definition of the holomorphic induction map Hol T . Every 
p € A* defines a 1-dimensional T-representation, denoted C M , where t — expA 
acts by f := e t{ ^ x) . We denote by R(K) (resp. R(T)) the ring of charac- 
ters of finite-dimensional if-representations (resp. T-representations) . We denote 
R-°°(K^ (resp. R~°°(T)) the set of generalized characters of K (resp. T). An 
element \ <= R~°°(K) is of the form \ = X^eA* m M X* > where p 1— > m M , A!j_ — > Z 
has at most polynomial growth. Likewise, an element \ € R~°°{T) is of the form 
X = X^eA* nV*'*! where p 1— > m M , A* — » Z has at most polynomial growth. We 
denote wop — w(p + p c ) — p c the affine action of the Weyl group on A*. The 
holomorphic induction map 

Hoi* : R-°°(T) — ► R-°°(K) 

is characterized by the following properties: 

i) Hol*(t") = xl for every p g A+, 

ii) Hol*(^ ^) = (-l^Hol*^) for every to g W and /1 g A*, 

iii) Hoi* = if o M n A^ = 0. 

2. Spin c - QUANTIZATION OF COMPACT HAMILTONIAN AT-MANIFOLDS 

In this Section we give a modified version of the 'quantization commutes with 
reduction' principle. 
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Let M be a compact Hamiltonian AT-manifold with symplcctic form u and mo- 
ment map $ : M — > 6* characterized by the relation X) = -w(1m, — ), where 
Xjv/ is the vector field on M generated by X £ t : Xjf(m) := ■* cxp(— tX).m\ t -Q, 
for m € M. 

Let J be a if-invariant almost complex structure on M which is not assumed to 
be compatible with the symplcctic form. We denote RR (M, — ) the Riemann-Roch 
character defined by J. Let us recall the definition of this map. 

Let E — * M be a complex if- vector bundle. The almost complex structure on 
M gives the decomposition AT*Ai (g)C = 8i,j A ij T*M of the bundle of differential 
forms. Using Hermitian structure in the tangent bundle TM of M, and in the 
fibers of E, we define a Dolbeault-Dirac operator d E + d E : A°' even (M, E) — > 
^°' odd (M, £7), where £7) := r(M, A*' 3 'T*M ® c £7) is the space of £7- valued 

forms of type The Riemann-Roch character RR (M,E) is defined as the 

index of the elliptic operator d E + d* E : 

RR K (M, E) = Index^^e + d* E ) G R{K) 

viewed as an element of R(K), the character ring of K. An alternative definition 
goes as follows. The almost complex structure defines a canonical invariant Spin c 
structure^. The Spin c Dirac operator of M with coefficient in E has the same prin- 
cipal symbol as \f2(d E + d E ) (see e.g. Jl4|), and therefore has the same equivariant 
index. 

In the Kostant-Souriau framework, M is prequantized if there is a if -equivariant 
Hermitian line bundle L with a if-invariant Hermitian connection V L of curvature 
— iu>. The line bundle L is called a prequantum line bundle for the Hamiltonian 
if-manifold (M, Recall that the data (V L ,$) are related by the Kostant 

formula 

(2.1) £ L (x)-vi M =»($,*), xet. 

Here C L (X) is the infinitesimal action of X on the section of L — > M. 

The tangent bundle Tili endowed with J is a complex vector bundle over M , 
and we consider its complex dual T^M := homc(TAi, C). We suppose first that 
the canonical line bundle k := detT^M admits a AT-equivariant square root n 1 / 2 . 
If M is prequantized by £, a standard procedure in the geometric quantization 



literature is to tensor L by the bundle of half- forms k 1 / 2 45 . We consider the 
index RR K (M, L k 1 / 2 ) instead of RR K (M,L). In many contexts, the tensor 
product L — L <S> ft 1 / 2 has a meaning even if L nor k 1 / 2 exist. 

Definition 2.1. ^4n Hamiltonian K-manifold (M, w, equipped with an almost 
complex structure, is K-prequantized by an equivariant line bundle L if '■= 
L 2 ® n~ l is a prequantum line bundle for (M, 2u>, 2$). 

The basic examples are the regular coadjoint orbits of K. For any fi G Al, 
consider the regular coadjoint orbit C" i+Pc := K ■ (p + p c ) with the compatible 
complex structure. The line bundle C^i = K x T C M is a K-prequantum line bundle 
over O^+^c , and we have 

(2.2) RR K {0»+<",t w ) = x" 



2 See subsection 4.1 for a short review on the notion of Spin c structure. 
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for any \i G A+. 

Definition |j can be rewritten in the Spin c setting (see subsection 4T for a brief 



review on Spin c -structures). The almost complex structure induces a Spin c struc- 
ture P with canonical line bundle detcTM — k^ 1 . If (M,u, J) is K-prequantized 
by L one can twist P by L, and then define a new Spin c structure with canonical 



L = L>2u (see Lemma 4.2). 



Definition 2.2. A symplectic manifold (M,u>) is Spin c -prequantized if there exists 
a Spin c structure with canonical line bundle L-2 U which is a prequantum line bundle 
on (M,2u>). If a compact Lie group acts on M, the Spin c -structure is required to 
be equivariant. Here we take the symplectic orientation on M . 

When (M, w, J) is K-prequantized by L, one wants to compute the if-multiplicities 



of RR (M, L) in geometrical terms, like in Theorem 1.2 



Definition 2.3. An element £ S t* is a quasi-regular value of $ if all the Kt- 

orbits in $ -1 (£) have the same dimension. A quasi-regular value is generic if the 
submanifold <I> _1 (£) is of maximal dimension. 

For any quasi-regular value £ € t*, the reduced space := 4> _1 (£)/.flf£ is 
an orbifold equipped with a symplectic structure u>£. Let L be a K-prequantum 
line bundle over M, and let L^ '■= L ® k _1 be the corresponding prequantum 
line bundle for (M, 2ui). For any dominant weight fi G A+ such that fi + p c is a 
quasi-regular value of $, 

(-E^f;|*-i(/i+p ) <8 C_2( M +p c ))/T 

is a prequantum orbifold- line bundle over (M M+Pc , 2oj m+Pc ). 

The following Proposition is the main point for computing the _ftT-multiplicities 
of RR (M,L) in terms of the reduced spaces M M+Pc := < E > ~ 1 (m + Pc)/T, p, G A+. 
It deals with the coherence of the definition of an integer valued map p G A^ i— > 
Q(M^ +Pc ). In the next proposition we suppose that (M, ui, <E>) is a Hamiltonian 
ii'-manifold with proper moment map. The set $(M) PI tl is denoted by A. By the 
Convexity Theorem [ p3| , |26| , |38| it is a convex rational polyhedron, referred to as 
the moment polyhedron. 



Definition-Proposition 2.4. Let (M, cj,$) 6e a Hamiltonian K -manifold, with 
proper moment map. We denote A° the relative interior of the moment polyhedron 
A := $(M)ntj_. Le£ L be a n-prequantum line bundle relative to an almost complex 
structure J. Let p G A5_. 

• Ifp + p c i A°, we set Q{M p+Pa ) = 0. 

• If p + p c is a generic quasi-regular value of <!>, f/ien the Spin c prequanti- 
zation defined by the data (J, L) induces a Spin c prequantization on the 
symplectic quotient {M p+Pc , uj p+Pc ). We denote Q(M p-+Pc ) G Z the index 
of the corresponding Spin c Dirac operator. 

• If p + p c G A° ; we take £ generic and quasi-regular sufficiently close to 
p + p c . The reduced space := <I> -1 (£)/T inherits a Spin c -structure with 
canonical line bundle (£2w|$-i(£) ® C_2( p + Pc ))/T- TTie index Q(M^) of the 
corresponding Spin c Dirac operator on does not depend of £, when £ is 
sufficiently close to p + p c : it is denoted <2(M M _|_ Pc ). 
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When £ = fi + p c is a generic quasi-regular of the line bundle (L^l^-i^) <S> 
C_2(^+p e ))/? 1 is a prequantum line bundle over (M M+Pc , 2w M + Pc ): so the second 
point of this 'definition' is in fact a particular case of the third point. But we prefer 
to keep it since it outlines the main point: Spin c prequantization is preserved under 
symplectic reductions. 

The existence of Spin c -structures on symplectic quotient is proved in Subsection 



4.2. The hard part is to show that the index Q( MA d oes not depend of £, for £ 



sufficiently close to p + p c : it is done in Subsection 4.3 



Note that Definition 2.4 becomes trivial when A° is not included in the interior 
of the Weyl chamber: Q(M fl+Pc ) = for all p E A+. However, in this paper we 
work under the assumption that the infinitesimal stabilizers for the if-action are 



Abelian. And that imposes A° C Interior{Weyl chamber} (see Lemma 4.9). 

The following 'quantization commutes with reduction 1 Theorem holds for the n- 
prequantum line bundles. 

Theorem 2.5. Let (M,lu,3>) be a compact Hamiltonian K -manifold equipped with 
an almost complex structure J. Let L be a n-prequantum line bundle over M , and 
let RR (M, — ) be the Riemann-Roch character defined by J . If the infinitesimal 
stabilizers for the action of K on M are Abelian, we have the following equality in 
R(K) 

(2.3) RR K (M, L)=eJ2 QU W ) X* > 

fj,eA* + 

where e = ±1 is the 'quotient' of the orientations defined by the almost complex 
structure, and by the symplectic form. 



Theorem 2.5 will be proved in a stronger form in Section 



Let us now give an example where the stabilizers for the action of K on M 



are not Abelian, and where (2.3) does not hold. Suppose that the group K is not 
Abelian, so we can consider a face a ^ {0} of the Weyl chamber. Let p c ^ a be half 
the sum of the positive roots which vanish on a, and consider the coadjoint orbit 
M := K ■ (p c — p c ,cr) equipped with its compatible complex structure. Since p c — p c . a 
belongs to a, the trivial line bundle JkfxC->Mis K-prequantum, and the image of 
the moment map $ : M — > 6* does not intersect the interior of the Weyl chamber. 



So M M+Pc = for every p, thus the RHS of (2.5) is equal to zero. But the LHS of 



(2.2) is RR (M, C) which is equal to 1, the character of the trivial representation. 



□ 



Theorem 2.5 can be extended in two directions. First one can bypass the con- 
dition on the stabilizers by the following trick. Starting from a K-prequantum line 
bundle L — > M, one can form the product M x (K ■ p c ) with the coadjoint orbit 
through p c . The Kunneth formula gives 

RR K (M x (K ■ p c ), LIC) = RR K (M, L) <g> RR K (K ■ p c , C) = RR K (M, L) 



since RR (K ■ p c , C) = 1. Now we can apply Theorem 2.5 to compute the multi- 
plicities of RR (M x (K ■ p c ),L M C) since L § C is a K-prequantum line bundle 
over M x (K ■ p c ), and the stabilizers for the if -action on M x (K ■ p c ) are Abelian. 
Finally we see that the multiplicity of the irreducible representation with highest 
weight p in RR (AT, L) is equal to eQ((M x (K ■ p c ))^ +Pc ). 
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On the other hand, we can extend Theorem 2.5 to the Spin c setting. It will be 
treated in a forthcoming paper. 



3. Quantization of non-compact Hamiltonian if -manifolds 

In this section (M, u>, $) denotes a Hamiltonian if -manifold, not necessarily com- 
pact, but with proper moment map $. Let J be an almost complex structure on 



M, and let L be a re-prequantum line bundle over (M, u>, J) (see Def. 2.1). From 



Proposition 2.4 the infinite sum 



(3-4) £ 2(^W)X* 

mga^j_ 

is a well defined element of R(K) :— homz(R(K ), Z). 

The aim of this section is to realize this sum as the index of a transversally 
elliptic symbol naturally associated to the data (M, J, L). 

3.1. Transversally elliptic symbols. Here we give the basic definitions of the 
theory of transversally elliptic symbols (or operators) defined by Atiyah in jlj . For 
an axiomatic treatment of the index morphism see Berline-Vergne |], [l^] and for a 
short introduction see ]33|| . 

Let M be a compact if -manifold. Let p : TM — > M be the projection, and let 
(— ,— )m be a if -invariant Riemannian metric. If E^^E 1 are if-equivariant vector 
bundles over M, a if-equivariant morphism a E T(TM,hom(p* E° ,p* E 1 )) is called 
a symbol. The subset of all (m, v) S TM where <t(to, v) : E^ — > fi^ is not invertible 
is called the characteristic set of er, and is denoted by Char(cr). 

Let T K M be the following subset of TM : 

T K M = {(to, v) G TM, (v, X M (m)) M = for all let}. 

A symbol a is elliptic if cr is invertible outside a compact subset of TM (Char(cr) 
is compact), and is transversally elliptic if the restriction of a to T^M is invertible 
outside a compact subset of T^M (Char(c)nTi<- M is compact). An elliptic symbol 
a defines an element in the equivariant if -theory of TM with compact support, 
which is denoted by Kr- (TM), and the index of a is a virtual finite dimensional 
representation of if |J, H H • 

A transversally elliptic symbol cr defines an element of K^(T/fM), and the 
index of a is defined as a trace class virtual representation of if (see [[j] for the 
analytic index and || |l0| for the cohomological one). Remark that any elliptic 
symbol of TM is transversally elliptic, hence we have a restriction map J£k (TM) — > 
K^(T^-M), and a commutative diagram 

(3.5) K K (TM) *K K (T K M) 



Indexf 



Index! 1 



R{K) ^R-°°(K) 



Using the excision property, one can easily show that the index map Index^ 
Kx(TxW) — > R~°°(K) is still defined when U is a if -invariant relatively compact 
open subset of a if- manifold (see (33| [section 3.1]). 
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3.2. Thorn symbol deformed by the moment map. To a if -invariant almost 
complex structure J one associates the Thorn symbol Thom A . (M, J), and the cor- 
responding Riemann-Roch character RR when M is compact |33|. Let us recall 
the definitions. 

Consider a if -invariant Riemannian metric q on M such that J is orthogonal 
relatively to q, and let h be the Hermitian structure on TM defined by : h(v, w) = 
q{v, w) — iq(Jv, w) for v, w G TM. The symbol 

Thom K (M, J) G r (M,hom(p*(A^ e "TM), p*(A^TM))) 

at (m, G TM is equal to the Clifford map 

(3.6) Cl m (t>) : Al ven T m M — > Ag drf T m M, 

where Cl m (w).w = v /\ w — Ch{v).w for u; G A£.T X M. Here c/j(u) : Aj.T m M — > 
A* _1 T m M denotes the contraction map relative to h. Since the map Cl m (w) is 
invertible for all v ^ 0, the symbol Thom^ (M, J) is elliptic when M is compact. 

The important point is that for any if -vector bundle E, Thom ff (M, J) <g>p*E 
corresponds to the principal symbol of the twisted Spin c Dirac operator T>e [fbl - 
So, when M is a compact manifold, the Riemann-Roch character RR (M, — ) : 
Kjf(M) — > R(K) is defined by the following relation 

(3.7) i?i? A (M, £7) = Index^ (Thom A . (M, J) ® p*£:) . 

Since the class of Thom A .(M, J) in ICr- (TM) is independent of the choice of the 
Riemannian structure, the Riemann-Roch character RR (M, — ) also does not de- 
pend on this choice. 

Consider now the case of a non-compact Hamiltonian if -manifold (M, u>, $). We 
choose a if -invariant scalar product on 6*, and we consider the function |j <E> || 2 : 
M — > R. Let H be the Hamiltonian vector field for ^ || <fr || 2 , i.e. the contraction 
of the symplectic form by H is equal to the 1-form ^-d | $ || 2 . In fact the vector 
field Ti only depends on $. The scalar product on 6* gives an identification i* ~ t, 
hence $ can be consider as a map from M to t. We have then 

(3.8) H m = ($(m)) M |m, meM, 
where ($(to))m is the vector field on M generated by $(m) G 6. 

Definition 3.1. TTie Thorn symbol deformed by the moment map, which is denoted 
by Thorn* (M, J), is defined by the relation 

Thorn* (M, J) (to, v) := Thom K (M, J) (to, v — TC m ) 

for any (to, v) G TM. Likewise, any equivariant map S : M — > t defines a 
Thorn symbol Thom A (Ai, J) deformed by the vector field Sm '■ m ^ S(m)M\m 
: Thom^(M, J)(m,v) :=Thom K (M, J)(m,v - S M (m)). 

Atiyah first proposed to 'deform' the symbol of an elliptic operator by the vector 
field induced by an S^-action in order to localize its index on the fixed point sub- 
manifold, giving then another proof of the Lefschetz fixed-point theorem |IJ [Lecture 
6]. Afterwards the idea was exploited by Vergne to give a proof of the 'quantiza- 
tion commutes with reduction' theorem in the case of an S^-action p2| . In (3j|, we 
extended this procedure for an action of a compact Lie group. Here, we use this 
idea to produce a transversally elliptic symbol on a non-compact manifold. 
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The characteristic set of Thom K (M, J) corresponds to {(to, v) G TM, v = Tim}, 
the graph of the vector field Tt. Since Tt belongs to the set of tangent vectors to 
the .ftT-orbits, we have 

Char (Thorn* (M, J)) n T K M = {(m, 0) G TM, TL m = 0} 

<* {to g M, d || $ \\l = 0} . 

Therefore the symbol Thorn* (M, J) is transversally elliptic if and only if the set 
Cr(|| $ || 2 ) of critical points of the function || $ || 2 is compact. 

Definition 3.2. Let (M, u>, $) be a Hamiltonian K -manifold with Cr(|| $ || 2 ) com- 
pact. For any invariant almost complex structure J, the symbol Thom^ (M, J) 
is transversally elliptic. For any K-vector bundle E — > M , the tensor product 
Thorn* (M, J) p* E is transversally elliptic and we denote by 

RRl(M,E) G r-°°{k) 

its inde^. In the same way, an equivariant map S : M — » I defines a transver- 
sally elliptic symbol Thom^(M, J) if and only if {to G M, Sm (to) — 0} is com- 
pact. If this holds one defines the localized Riemann-Roch character RR S (M, E) :— 
Index^(Thon4 (M) ®p f E). 

Remark 3.3. If M is compact the symbols Thom JC (M, J) and Thorn* (M, J) are 

homotopic as elliptic symbols, thus the maps RR (M, — ) and RR^ (M, — ) coincide 
(see section 4 of |[33| j. 

We end up this subsection with some technical remarks about the symbols 
Thom^ (AI, J) associated to an equivariant map S : M — > t, and an almost complex 
structure. 

Let U be a if- invariant open subspace of M. The restriction Thorn^ (M, J)\u = 
Thom^(W, J) is transversally elliptic if and only if {m G M, S'm(to) = 0} n W is 

compact. Let j : U <^-> V be two if- invariant open subspaces of M, where j 
denotes the inclusion. If {to G M, S M (rn) = 0}flM = {m6 M, S M (m) =0}nV 
is compact, the excision property tells us that 

j"' V (Thom S K (U, J)) = Thom^(V, J) , 
where j"' V : K^^W) — > Kjf(T^-V) is the pushforward map (see Q [Section 3]). 

Lemma 3.4. (1) If {m G M, S'm(to) = 0} n hi is compact, then the class 
defined by Thom^.(W, J) in K/f (T^W) does not depend on the choice of a 
Riemannian metric. 



^Here we take a /("-invariant relatively compact open subset hi of M such that Cr(|| $ || 2 ) C hi. 
Then the restriction of Thorn* (M, J) to U defines a class Thorn* (M, J)\ u G K K (T K U). Since 

the index map is well defined on U, one sets RR^ (M,E) := Index^ (Thom* (M, J)\u®P*E\ u ). 
A simple application of the excision property shows us that the definition does not depend on the 
choice of U. In order to simplify our notation (when the almost complex structure is understood), 
we write RR*(M, E) : = Index^ (Thom* (M) ® p*E). 
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(2) Let S ^ 1 : M — > f be two equivariant maps. Suppose there exist an open 
subset IA C M, and a vector field 9 onlA such that {S M ,9) M and {S\.j,9) M 
are > outside a compact subset K, oflA. Then, the equivariant symbols 
Thom^ (U, J) and Thom^ (U, J) are transversally elliptic and define the 
same class in K^-(Tx^). 

(3) Let J°, J 1 be two almost complex structures on U, and suppose that 
{to G M, Sm {fri) =0}flW is compact. The transversally elliptic symbols 
Thom S K (U,J°) and Thom^ (U, J 1 ) define the same class if there exists a 
homotopy J*, t G [0, 1] of K- equivariant almost complex structures between 
J° and J 1 . 

Proof. Two J- invariant Riemannian metrics goi9i are connected by q t :— 
(1 — t)qo + tqi. Hence the transversally elliptic symbols Thom^. (U, J, qo) and 
Thorn^ (U, J, qi) are tied by the homotopy t i— > Thom^ (U, J, qt). The point 1. is 
then proved. The proof of 2. is similar to our deformation process in |f3l|| . Here we 
consider the maps S t := tS 1 + (1 — t)S°, t € [0, 1], and the corresponding symbols 
Thomf (U, J). The vector held 9, ensures that Char(Thomf (U, J)) n T K U C K 

qt 

is compact. Hence t — > Thom K (14, J) defines a homotopy of transversally elliptic 



symbols. The proof of 3. is identical to the proof of Lemma 2.2 in 33 



□ 



Corollary 3.5. When {to 6 M, Sm (jn) = 0} is compact, the generalized Riemann- 
Roch character RRg (M, —) does not depend on the choice of a Riemannian metric. 
RR S (M, — ) does not change either if the almost complex structure is deformed 
smoothly and equivariantly in a neighborhood of {m G M, ^/(m) = 0}. 



In Subsections 3.3 and 3.4, we set up the technical preliminaries that are needed 
to compute the K- multiplicity of RR^{M, L). 

In Section^, we compute the K- multiplicity of RR^(M,L), when the moment 
map is is proper, in terms of the symplectic quotients M fJi+Pc , \x G A^j_. 

3.3. Counting the i-T-multiplicities. Let E be a -fsT-vector bundle over a Hamil- 
tonian manifold {M, u>, $) and suppose that Cr(|| $ || 2 ) is compact. One wants 
to compute the K- multiplicities of RR$(M, E) G R~°°(K), i.e. the integers 
m Al (£') G Z, fj, G such that 

(3.9) RRl{M,E)= ■ 



+ 



For this purpose one use the classical 'shifting trick'. By definition, one has 
m M (£') = [RRfy (M, E) ® V*] K , where is the irreducible if-representation with 



highest weight ji, and V* is its dual. We know from (2.2) that the if-trace of is 
Xl =RR K {0»,t M ), where 

(3.10) /I = fi + p c . 

Hence the if-trace of the dual V* is equal to RR K (O^ 1 , C[_ M j), where C" 1 is the coad- 
joint orbit O m with opposite symplectic structure and opposite complex structure. 
Let Thom K (C' 1 ) be the equivariant Thorn symbol on Then the trace of V* is 
equal to Index^ (Thom^ (O' 1 ) (8 C[_^i), and finally the multiplicative property of 
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the index § [Th eorem 3.5] gives 

m^E) = [lndex* xOP ((Thorn* (M) ®p*E) (Thom K (OA) €[_„]))]* . 

See [0, H|, for the definition of the exterior product : K K (T K M) x Kk(TOA) _> 
Kx(T x (M x OA)). 

The moment map relative to the Hamiltonian AT-action on M x is 

$ A : M x OA — „ r 
(3.11) (m,0 — » $(m)-e 

For any i G K, we consider the map <& t £ : Mx OA — ► {*, $>tji(m, ■= $(m) — if. 

Assumption 3.6. There exists a compact subset K, C M, swc/i i/iai, /or every 
t £ [0,1], ifte critical set of the function || $t A || 2 : M x — > R is contained in 
k: < OK 



If M satisfies Assumption 3.6 at /i, one has a generalized Riemann-Roch char- 
acter RR^ f _(M x O* 1 ,— ) since Cr(|| $ A || 2 ) is compact. 

Proposition 3.7. Let m fl (E) be the multiplicity of RR <S ,{M,E) relatively to the 
highest weight (i G Ai_. If M satisfies Assumption 3.1 at ft, then 

r k — i K 
m^(E)= RRg,_.(M x C,£BC H ) 

Proof. One has to show that the transversally elliptic symbols Thorn* (M) 
Thom K (OA") and Thorn*/ (M x OA) define the same class in K K (T K (M x €>>*)) 
when M satisfies Assumption |3 . 6| at ft. Let <n, o~i be respectively the Thorn symbols 
Thom K (M) and Thom K (OA). The symbol 07 = Thorn* (M) Thom K (OA) is 
defined by 

07 (m, £,«,«;) =o-i(m,v-H m )®o- 2 (£,w) , 

where (to, v) € TM, (£, w) £ TO' 2 , and H is defined in (|J). Let H* be the vector 
field on M x O* 1 generated by the map : M x O a -> 6. For (m, £) S M x O a , 
we have H| TOjf) = W^) where e T m M and H b £ A) G T^A. The 

symbol 071 = Thorn*/ (M x OA) is defined by 

o- n (m,£,,v,w) = ai(m,v - H^) a 2 (^,w - H^ ^) . 

We connect 07 and 07/ through two homotopies. First we consider the symbol A 
on [0, 1] x T(M x OA) defined by 

A(t\ m, f, v, w) = ai(m,v- H^ ( ) a 2 (^,w - W(^ )S) ) , 

fort e [0, 1], and (m,£,v,w) € T(MxOA). We have Char (A) = {(i; m, f, v, w) \ v = 
'Kn.v and w = H (m,f)} and 

Char(A)f|[0,l]xT^(AfxO' i ) = {(t; to, £, 0, 0) | (to, f) e Cr(|| $ tA || 2 ) } 

C [0, 1] x AC x OA , 
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where JC C M is the compact subset of Assumption 3.6 . Thus A defines a homotopy 
of transversally elliptic symbols. The restriction of A to t = 1 is equal to an. The 
restriction of A to t — defines the following transversally elliptic symbol 

aiii(m,£,,v,w) = ai(m,v - TL m ) cr 2 (£,w - %(m,$)) 

since H^f^ = H m for every (m, £) G M x O' 2 . Next, we consider the symbol B on 
[0, 1] x T(M x O^) defined by 

B(t;m,£,v,w) = cri(m,v -H m ) Q a 2 (^,w - tH^ ^) . 

We have Char(£>) = {(£; m, £,,v,w) \ v = 7i m , and w = tTL b ^ ^} and 

Char(B) p|[0, 1] x Tjf (M X C" 1 ) C 

{(tjm.&i; =?<„„«; = t«££ ) , || H m || 2 + * || H b & & || 2 = } . 

In particular Char(B) n [0,1] x T K (M x C" 1 ) is contained in 
{(*;TO,£,0,to = tH^,), to G Cr(|| $ || 2 )} which is compact since Cr(|| $ || 2 ) 
is compact. So, -B defines a homotopy of transversally elliptic symbols between 
07 = B\t=o and ct/// = B\t=i- We have finally proved that <Ji,crii,criii define the 
same class in K K (T K (M x C" 1 )). □ 

When E = L is a K-prequantum line bundle over M, the line bundle L M C[_ M ] 
is a K-prequantum line bundle over M x O' 1 . Therefore Proposition |3.7| shows that 



under Assumption 3.6 the AT-multiplicities of RR^(M,L) have the form 
(3.12) [UR*(X,L X )] K , 

where (X,ujx,§) is a Hamiltonian K-manifold with Cr(|| $ || 2 ) compact, and 
is a K-prequantum line bundle over X relative to a i^-invariant almost complex 



structure. In order to compute the quantity (3.12), we exploit in the next subsection 
the localization techniques developed in j33j . 

3.4. Localization of the map RR§ . For a detailed account on the procedure of 
localization that we use here, see Sections 4 and 6 of In this section (X, u>x, 
is a Hamiltonian if-manifold which is equipped with a if-invariant almost com- 
plex structure, and a K-prequantum line bundle L. We suppose furthermore that 
Cr(|| $ || 2 ) is compact. We give here a condition under which [RR^ (X, L)] K de- 
pends only on the data in the neighborhood of <E> _1 (0). 

For any (3 £ 6, let X 13 be the symplectic submanifold of points of X fixed by 
the torus generated by (3. Following Kirwan ]22] ], the critical set Cr(|| <fr || 2 ) 
decomposes as 

(3.13) Cr(|| $ || 2 ) = (J Cj , with C K & = K.{X$ n IT 1 ^)), 

where B is the subset of t; defined by B := {/3 G t+, A'' 3 n ^(Z 3 ) 7^ 0}- Since 
Cr(|| $ || 2 ) is supposed to be compact, B is finite. 

For each (3 £ B, let U °-> A" be a if-invariant relatively compact open neighbor- 
hood of (7g such that ZY' 3 D Cr(|| $ || 2 ) = (7g . The restriction of the transversally 
elliptic symbol Thorn* (X) to the subset if defines Thorn* (z/) G K x {T K u"). 
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Definition 3.8. For every (3 £ B, we denote by RRp (X, — ) the Riemann-Roch 
character localized near Co , which is defined by 

RRp{X,E) = Index^ 3 (Thorn* (z/) <g> p*E\ L 
for every K -vector bundle E — ► X. 
The excision property tells us that 

(3.14) RrI (X, E) = J2 RR ( X > E ) 

0&B 



for every K- vector bundle E — > X (see 33 [Section 4]). In particular, 
[RR^(X,L)] K — plRR'p {X , L)] K , and our main point here is to find suitable 
conditions under which [RR^(X, L)] K — for [3^0. 

Let (3 be a non-zero element in t. For every connected component Z of X@, 
let Nz be the normal bundle of Z in X. Let af , • • • , af be the real infinitesimal 
weights for the action of on the fibers of Nz <S> C. The infinitesimal action of [3 
on Mz ® C is a linear map with trace equal to \/— T^^af, /?). 

Definition 3.9. Let us denote by TrplJVz] the following positive number 

i 

Tr e\Afz\:=J2\(af,f3)\ , 

i=l 

where af , • • • , af are the the real infinitesimal weights for the action ofTp on the 
fibers of Mz ® C. For any fp-equivariant real vector bundle V — > Z (resp. real 
Tp-equivariant real vector space E), we define in the same way Tr^lVl > (resp. 
Tvp\E\>0). 

Remark 3.10. IfV = V^V 2 , we have Trp\V\ = Tr^V 1 ! + Trp\V% and ifV is 

an equivariant real subbundle ofV, we get Tr^|V| > Tr^lV'l. In particular one see 
that Trp\J\fz\ = r ^ r /3\ r ^^\z\> o-nd then, if E m c T m X is a Tp-invariant real vector 
subspace for some m £ Z , we have Trp\Mz\ > T^p\E m \. 

The following Proposition and Corollary give us an essential condition under 
which the number [RR$ (X, L)] K only depends on data localized in a neighborhhood 
of^-^O). 

Proposition 3.11. Let L be a n-prequantum line bundle over X . The multiplicity 
of the trivial representation in RR^ (X,L) is equal to zero if 

(3.15) \\(3\\ 2 +^Trp\N z \-2{p c ,f3)>Q 



for every connected component Z of X^ which intersects $ 1 ((3). Condition (3.11 ) 
always holds if (3 G 6 — {0} is K -invariant or if || (3 ||>|| p c \\. 

Since every (3 € B belongs to the Weyl chamber, we have 2(p c ,/3) = Tr^|6/t|, 
and then fl3.15p can be rewritten as || (3 || 2 +±Trp\JV z \ -Tvp\t/l\ > 0. From (fjj), 
we get 
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Corollary 3.12. If condition (3.11 ) holds for all non-zero (3 G B, we have 



RR® (X, L) 



K 



RRq {X , L) 



K 



where RR (X, — ) is the Riemann-Roch character localized near $ 1 (0) (see Defi- 
nitional^). In particular, [RR^ (X , L)] K — if (3.11, ) holds for all non-zero (3 G B, 
and ^ Image($). 



3.5. Proof of Proposition 3.11. When (3 € 6 is if- invariant, the scalar product 
(p c ,(3) vanishes and then (3.15) trivially holds. Let us show that ( 3.1 5| ) holds when 
|| (3 ||>|| p c || . Let Z a connected component of X® which intersects $ _1 (/3). Let 
m 6 $ _1 (/3) n Z, and let E m C T m X be the subspace spanned by Xx{m), let. 
We have E m ~ 6/6 m , where t m := {X G t, X x (m) = 0}. Since $(m) = /?, and $ 
is equivariant 6 m C tp := {X G 6, [X, /?] = 0}, so T m X contains a T^-equivariant 
subspace isomorphic to 6/6/3. So we have Tr p\Afz\ > Tr/dV^I = 2(p c , /?), and then 

1. 



> 
> 







□ 



since || /3 ||>|| p c m 

We prove now that condition ( |3.15| ) forces [i?i£^ (A", L)]^ to be equal to 0. 
Let mp^(E) G Z be the if -multiplicities of the localized Riemann-Roch charac- 
ter RRp(X,E) introduced in Definition |J : RR^(X,E) = £ M eA; rnp jM (E) x«- 
We show now that mpfi(L) — 0, by using the formulas of localization that we 
proved in ||| for the maps RRp(X, — ). 

First case : (3 G B is a non-zero K -invariant element oft*. 

We show here the following relation for the multiplicities mp^(L) : 



(3.16) mp^L) ± 



1 



(p,f3) >\\/3\\ 2 +-Tr^|A^| for some Z G X^ , 



in particular mp (L) = 0. 

Since Tp belongs to the center of if, X 13 is a symplectic if-invariant subman- 
ifold of X . Let TV be the normal bundle of X 13 in X. The if-invariant almost 
complex structure of X induces a if-invariant almost complex structure on 
and a complex structure on the fibers of TV — > X 13 . Then we have a Riemann- 
Roch character RR^ (X^ ', — ) localized along A'' 3 n <l> _1 (/3) with the decomposition 
i?i?^ (A' 3 , F) = £ 2 RR p (Z, F\ z ), where the sum is taken over the connected com- 
ponents Z C X 13 which intersect 3> _1 (/3). The torus To acts linearly on the fibers of 
the complex vector bundle TV, thus we can associate the polarized complex if -vector 
bundle Af+'P and (TV ® C)+'^ (see Definition 5.5 in Q): for any real T^-weight a 
on TV+" 8 , or on (TV ® C) +,/3 , we have 

(3.17) (a,/3)>0. 

We proved the following localization formula in Section 6.2 of Q which holds in 

R(K) for any if -vector bundle B over X : 

(3.18) 



i?-Rg (X, E) = (-1) 



fceN 



i?i?,3 (X 13 , E\ XP ® detTV+' /3 ® S fc ((TV <g> C)+' /3 )) 
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Here rj^ is the locally constant function on X 13 equal to the complex rank of A/" +,/3 , 
and S k {— ) is the fc-th symmetric product over C. 

Let i : tp c — > t be the inclusion of the Lie algebra of T^, and let i* : t* — > 
be the canonical dual map. Let us recall the basic relationship between the fp- 
weight on the fibers of a if-vector bundle F — > X@ and the if-multiplicities of 
RRp , F) S R{K): if the irreducible representation occurs in RRp , F), 
then is a T^-weight on the fibers of F (see Appendix B in [3^]). 

If one now uses (3.18), one sees that m Mi ^(L) ^ only if i*(/Lt) is a T^-weight 
on the fibers of some L\ z ® det Np ® 5 fc ((A^ <g> C)+< ). Since (i*(n),(3) = (fj,,/3), 
( |3.16| ) will be proved if one shows that each T^-weight j z on L\z © det A/J'' 3 © 
S k ((Afz © C) +i/3 ) satisfies 

(3-19) (7*,/?)>H0ll 2 +^|A^| • 

Let a z be the T^-weight on the fiber of the line bundle L\z © det A/J Since 
any T^-weight on S fe ((A" ® C)+> /3 ) satisfies ( p7| ), ( p9| ) holds if 

(3.20) («»,/?) >||0l| a +^B|Ms| 

for every Z c A'' 3 which intersects $ _1 (/3). Let Z^u be the prequantum line 
bundle on (M, 2ui, 2$) such that L 2 — L^u © k (where k is by definition equal to 
det(T* c X) = det(TVt)- 1 ). We have 

{L\ z ®det{N + ' 13 )) 2 = L 2ij \z®Aet{TX)- l \z 0det(AA+" 9 ) 2 . 

So 2a z = ct\ + ai where ct\, a 2 are respectively T^-weights on L 2 J\z and 
det(TA , )~ 1 | 2 det(A/' + ' /3 ) 2 . The Kostant formula (|1]) on L 2 J Z gives (ai,X) = 
2(P,X) for every A € tp, in particular 

(3.21) («!,/?) -2 ||/3 || 2 . 

On Z, the complex vector bundle TX has the following decomposition, TX\z = 
TZ © A/' - '' 3 © A" + ' /3 , where A' - '' 3 is the orthogonal complement of A" +,/3 in A": 
every T^-weight 8 on A' - '' 3 verifies (5, (5) < 0. So we get the decomposition 
detiTX)- 1 ^ © det(A"+^) 2 = det(TZ) © det(A'-^)- 1 © det(A"+^) , which gives 

(3.22) (a 2 ,0)=Trp\Af z \ 

since acts trivially on TZ. Finally (3.2C) follows trivially from (3.21) and (3.22). 
Second case : (3 € B such that Kp K. 

Consider the induced Hamiltonian action of Kp on X, with moment ma p $>K g ■ 
X — > Pp. Let B' be the indexing set for the critical point of || || 2 (see ( 3.13 )). 



Following Definition 3.8, for each f3' <E B' we consider the if^-Riemann-Roch char- 
acter RRp?(X,-) localised along Cpf = Kp.(X^' n (/?'))• Here P is a K P~ 
invariant element of B' with (fj = X 13 n 



Let HoL : R-°°{T) -> R-°°(K), Hoi" 3 : R-°°(T) -> R-°°{Kp), and Hoi 



i? 00 (if/3) — > i? 00 (if) be the holomorphic induction maps (see Appendix B in 



|33[). Recall that Hoi = Hoi , 0H0I 13 . The choice of a Weyl chamber determines 



a complex structure on the real vector space 6/6/3. We denote by 6/6/3 the vector 
space endowed with the opposite complex structure. 



20 



PAUL-EMILE PARADAN 



The induction formula that we proved in J3j| [Section 6] states that 



(3.23) RRp {X, E) = Hoi [RRp (X, E) A* l/lp 

for every equivariant vector bundle E. Let us first write the decomposition 
RR /3 fl (X,L) = X^eA+ m P,v(-L)x*' 3 m t° irreducible characters of Kp. Since (3 
is ^-invariant we can use the result of the First case. In particular ( 3.16 ) tells us 
that 

(3.24) m^{L) ^ => (/x, 0) > \\ [3 || 2 +±Trp\M z \ 
for some connected component Z C X 13 which intersects <J> _1 (/3). 



Each irreducible character is equal to Hol T (f), so from fl3.23| ) we get 
RR*(M,L) = Hof((X; M m^(L)^)n Qe!R+(l/(fl) (l where !*+(«/«,,) is 

the set of positive T-weights on : so (a,/3) > for all a £ 9\ + (t/tp). Finally , 
we see that RRp(M,L) is a sum of terms of the form mp^(L) Hol T (t^~ ai ) where 
ai = J2a£i a an d I is a subset of 9{ + (t/tp). We know that Hol r (i M ) is either or 

the character of an irreducible representation (times ±1) ; in particular Hoi (t^ ) 
is equal to ±1 only if (fj,',X) < for every X <E t + (see Appendix B in [p3|). So 
[RRp (M, L)\ ^ only if there exists a weight /i such that mp^(L) ^ and that 

Hol*(^- Q ') = ±1. The first condition imposes (/z,/3) >|| (3 || 2 +±Trp\N z \ for 
some connected component Z C A'' 3 , and the second one gives (/x,/3) < (a/,/3). 
Combining the two we end up with 

\\ \\ 2 +±Tr P Wz\ < < £ (<*, ft = 2{p B) p) , 

for some connected component Z C A'' 3 which intersects $ _1 (/?). This completes 
the proof that [RR^(M,L)] K = if || f3 || 2 +±Tr fj \JV z \ > 2(p c ,[3) for every 
component Z C which intersects $ _1 (/3). □ 

4. Quantization commutes with reduction 

Let (M, u>, $) be a Hamiltonian if -manifold equipped with an almost complex 
structure J. In this section, we assume that the moment map $ is proper and that 
the set Cr(|| $ || 2 ) of critical points of || $ || 2 : M — ► R is compact. We denote the 
corresponding Riemann-Roch character by RR$(M, — ) (see Definition |3.2| ). Let 
A := $(M) n il be the moment polyhedron. 

The main result of this section is the following 



Theorem 4.1. Suppose that M satisfies Assumption 3.6 at every fl G t*, and 
that the infinitesimal stabilizers for the K-action on M are Abelian. If L is a 
n-prequantum line bundle over (M,uj,3>,J), we have 

(4.25) RR*(M,L)=e V Q(M M+P J X « , 



+ 



where e — ±1 is the 'quotient' of the orientation o(J) defined by the almost complex 
structure and the orientation o{uj) defined by the symplectic form. Here the integer 
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<2(M M + Pc ) is computed by Proposition 2.4- In particular, <2(M M + Pc ) =0 if /i + p c 
does not belong to the relative interior of A. 

The same result hold s in the traditional 'prequantum' case. Suppose that M 
satisfies Assumption 3J3 at every /i g f, and that the almost complex structure 
J is compatible with lu. If L is prequantum line bundle over (M, lo,3>), we have 
RR*(M, L) = £ peA . RR(M», L„) x? ■ 

The next Lemma is the first step in computing the if- multiplicities m M (L) of 
RR^ (M, L). Since (M, $) satisfies Assumption at every p, we know from 
Proposition |3Tt| that m M (Z) = [RR^^M xO^,LM C[_ m] )] k for every p e A* + - 

Let RRq [M x Oi 1 , — ) be the Riemann-Roch character localized near $r 1 (0) ~ 
+ p c ) (see Definition 3.8). This map is the zero map if < f )_1 (/i + p c ) = 0- 



Lemma 4.2. Let L be a n-prequantum line bundle over M. Suppose that the 



infinitesimal stabilizers for the K -action are Abelian and that Assumption 3.6 is 
satisfied at p. We have then 

K 

(4.26) 



m M (L) = RR Q (M x 0&,L 153 C[_ 



In particular m /x (L) =0 if (1 + p c does not belong to the moment polyhedron A. 



Proof. The lemma follows from Corollary 3.12, applied to the Hamiltonian man- 
ifold X := M x C' 1 , with moment map <E>^ and K-prequantum line bundle ZKICr-^i. 
Let /3 ^ such that n ^(/J) 7^ 0- Let be the normal bundle of X® in Af, 



and let x G A" 73 n (/3). From the criterion of Proposition 3.11, it is sufficient to 
show that 

(4.27) \\P\\ 2 + l -Tr p \N x \-2( Pc ,f3)>0 . 

Write x = (m,f) with m S and £ S (C 1 )' 3 . We know that Tr \Af x \ = 
Tr \T x X\ = Tr^|T ro M| +Tr p \T^\. 

Since the stabilizer ~ t is Abelian and (3 £ we have 6j C 6^. Then the 
tangent space ~ t/t s contains a copy of l/tp, so Tr^T^I > Trp\t/tp\ = 

2(p c , (3). On the other hand, T m M contains the vector space E m ~ t/t m spanned by 
Xm{itl), let. We have assume that the stabilizer subalgebra t m is Abelian, and 
since (3 € t m , we get 6 m C Thus C S m C T m M and Tr )9 |T m M| > 2(p c , (3). 
Finally ( |4.27| ) is proved since ±(Tr \T m M\ +Trp\T e O li \) > 2(p c 



,/?)• □ 



The remaining part of this section is devoted to the proof of Theorem 4.1. Fol- 
lowing the preceding Lemma we have to show that 

K 



(4.28) 



RR (M xO^,L® Cr_ M] ) = eQ(M i 



1 H + Pc 



where Q{M^ +Pc ) is defined in Proposition |2. 4 



In Subsection 4.1, we recall the basic notions about Spin c -structures. The ex- 



istence of induced Spin c -structures on symplectic quotient is proved in Subsection 



4.2. The proof of (4.28) is settled in Subsection 4.3. We give in the same time the 
proof of the 'hard part' of Proposition 2.4: the fact that the index Q(M^) does not 
depend on £, for £ sufficiently close to p + p c . 
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4.1. Spin c structures and symbols. We refer to Lawson-Michelson [£5| for back- 
ground on Spin c -structures, and to Duistermaat for a discussion of the sym- 
plectic case. 

The group Spin n is the connected double cover of the group SO„. Let r\ : Spin„ — > 
SO„ be the covering map, and let e be the element who generates the kernel. The 
group Spin^ is the quotient Spin n x^ 2 Ui, where Z2 acts by (e, — 1). There are two 
canonical group homomorphisms 

77 : Spin^ — > SO„ , Det : Spin^j — > Ui . 

Note that if = (77, Det) : Spin^ — > SO„ x Ui is a double covering map. 

Let p : E — > M be a oriented Euclidean vector bundle of rank n, and let 
Pso(-E0 be its bundle of oriented orthonormal frames. A Spin c -structure on E 
is a Spinjj principal bundle Pspin ^) — > M, together with a Spin c -equivariant map 
Pspin (-B) -> Pso(E). The line bundle 

(4.29) L:=P Spin c(£) x Dot C 
is called the canonical line bundle associated to Pspin c 

(E). We have then a double 

covering map^J 

(4.30) V C E : P Spin o(E) —> P so (E) x Pu(L) , 

where Pu(L) := Pspin°(-E) XDct Ui is the associated Ui-principal bundle over M. 

A Spin c -structure on a oriented Riemannian manifold is a Spin c -structure on its 
tangent bundle. If a group K acts on the bundle E, preserving the orientation and 
the Euclidean structure, we define a if-equivariant Spin c -structure by requiring 
Ps P in c (-E) to be a if-equivariant principal bundle, and ( 4.30Q to be (K x Spin^j)- 
equi variant. 

Let be the complex Spin representation of Spin^. Recall that = 

A 2^ © A^ inherits a canonical Clifford action c : R 2m — > Endc(A2 m ) which is 
Spin^-equivariant, and which interchanges the grading : c(v) : Af m — ► A^ m , for 
every v € R 2m . Let 

(4.31) S(E) := P Spin c (E) x Spin c m A 2m 

be the spinor bundle over M, with the grading S(E) := S(E) + S(E)~ . Since 
E = Ps P in c (-E) Xs P in| m R 2m , the bundle p*S(E) is isomorphic to Pspin^-B) x S P in- m 
(R 2m ©_A 2m ). 

Let E be the bundle E with opposite orientation. A Spin c structure on E induces 
a Spin c on E, with the same canonical line bundle, and such that S(E) ± = S(E)^ . 



Definition 4.3. Let S-Thom(£') : p*S(E)+ -> p*S(E)~ be the symbol defined by 

v 2m) 



Pspinc(-B) x Spinlm (R 2m © A+ m ) — » Ps P i„c(£) x S pi„ iro (R 2m © A2 



[p;v,w] 1 — > [p, v, c(v)w] . 

When E is the tangent bundle of a manifold M , the symbol S-Thom(i?) is denoted 
by S-Thom(Af). If a group K acts equivariantly on the Spin c -structure, we denote 
by S-ThoniR-(I?) the equivariant symbol. 



4 If P, Q are principal bundle over M respectively for the groups G and H, we denote simply 
by P X Q their fibering product over M which is a G x H principal bundle over M. 
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The characteristic set of S-Thom(i?) is M ~ {zero section of E}, hence it defines 
a class in K.(E) if M is compact (this class is a free generator of the K(M)-modulc 
K(_E) ||). When E = TAf, the symbol S-Thom(M) corresponds to the principal 
symbol of the Spin c Dirac operator associated to the Spin c -structure [l4| . If more- 
over M is compact, the number Q(M) S Z is defined as the index of S-Thom(M). 
If we change the orientation, note that Q(M) = — Q(M). 

Remark 4.4. It should be noted that the choice of the metric on the fibers of E is 
not essential in the construction. Let go,gi be two metric on the fibers of E, and 
suppose that (E,go) admits a Spin c -structure denoted by P Spin" {E, go)- The trivial 
homotopy gt = {\ — t).go + t.g\ between the metrics, induces a homotopy between the 
principal bundles Pso(E, go), Pso{E, gi) which can be lifted to a homotopy between 
Pspin'K-E', go) and a Spin c -bundle over (E,gi). When the base M is compact, the 
corresponding symbols S-Thom(.E, go) and S-Thom(i5, g\) define the same class in 
K(E). 

These notions extend to the orbifold case. Let M be a manifold with a locally 
free action of a compact Lie group H. The quotient X := M/H is an orbifold, a 
space with finite quotient singularities. A Spin c structure on X is by definition a H- 
equivariant Spin structure on the bundle T#M — > M, where TjjM is identified 
with the pullback of TX via the quotient map it : M — > X, We define in the 
same way S-Thom(Af) € K orb (TX), such that 7 r*S-Thom(A') = S-Thom H (T H M). 
Here K or ;, denotes the if-theory of proper vector bundles |2lJ . The pullback by tt 
induces an isomorphism ir* : K or f,(TA') ~ T£h(ThM). The number Q(X) G Z is 
defined as the index of S-Thom(A'), or equivalently as the multiplicity of the trivial 
representation in Index^(S-Thomjj(TjjM)). 

Consider now the case of a Hermitian vector bundle E — > M, of complex rank 
m. The orientation on the fibers of E is given by the complex structure J. Let 
Pu(E) be the bundle of unitary frames on E. We denote by i : U m S02 TO the 
canonical inclusion map. We have a morphism j : U m — > Spin2 m which makes the 
diagram 



(4.32) U m ^ Spin 




2)» 



>2m X Ui . 

commutative p5j. Then 

(4.33) Pspm-(^) := Spin° m Xj Pu(^) 

defines a Spin c -structure over E, with canonical line bundle equal to detc E. 

Lemma 4.5. Let M be a manifold equipped with an almost complex structure J. 



The symbol S-Thom(Af ) defined by the Spin c -structure (4-3i ), and the Thorn symbol 



Thom(A/, J) defined in Section S.i coincide 



Proof. The Spinor bundle S is of the form Ps p i n c (TAf) Xs p i n = ^-2m = 
Ptj(TM) x Um A 2m . The map c : R 2m -> End c (A 2m ), when restricted to the 
U m -equivariant action through j, is equivalent to the Clifford map CI : R 2m — > 
End c (AC m ) (with the canonical action of U m on K 2m and AC" 1 ). Then S = A C TM 
endowed with the Clifford action. □ 
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Lemma 4.6. Let P be a Spin c -structure over M, with bundle of spinors S, and 
canonical line bundle L. For every Hermitian line bundle L — > M , there exists a 
unique Spin c -structure Pl with bundle of spinors S ® L, and canonical line bundle 
L ® L 2 (Pl is called the Spin c -structure P twisted by L). 

Proof. Take P L = P x Vl P V (L). 

We finish this subsection with the following definitions. Let (M, o) be an oriented 
manifold. Suppose that 

• a connected compact Lie K acts on M 

• (M, o, K) carries a if-equivariant Spin c -structure 

• one has an equivariant map W : M — > t. 

Suppose first that M is compact. The symbol S-Thom^ [M) is then elliptic and 
defines a map 

Q K {M,~) :K K (M)^R(K) 

by the relation Q K {M,V) := Index^ (S-Thom K (M) <g> V). Thus Q K {M, V) is the 
equivariant index of the Spin c Dirac operator on M twisted by V. 

Let ^>m be the equivariant vector field on M defined by fjif("i) : = ^{m)M\m- 

Definition 4.7. The symbol S-Thom^M) deformed by the map "J , which is de- 
noted by S-Thom*(M), is defined by the relation 

S-Thom* (M)(m, u) := S-Thom K (M) (m, t> - **r(m)) 

/or any (m,v) G TAf. 77ie symbol S-Thom* (M) is transversally elliptic if and 
only if {m £ M, ^M{m) = 0} is compact. When this holds one defines the localized 
map Qy(M,V) := Index^ (S-Thom* (M) ® V). 

We finish this section with an adaptation of Lemma 9.4 and Corollary 9.5 of 
|33) [Appendix B] to the localized map Q^(M, — ). Let (3 € t+ be a non-zero element 
in the center of the Lie algebra t = 6* of if. We suppose here that the subtorus 
i:Tp K, which is equal to the closure of {exp(t./3), i G R}, acts trivially on M. 
Let m (U (F), € be the AT-multiplicities of Q^(M, V). 

Lemma 4.8. If m^(V) 7^ 0, i*(/x) is a weight for the action ofTp on V®L^. 
If each weight a for the action of Tp on V ® L2 satisfies (a,/3) > 0, then 
[Q*(M,V)] K = 0. 

4.2. Spin c structures on symplectic reductions. Let (M, be a Hamilton- 
ian AT-manifold, such that <£> is proper. Let J be a AT-invariant almost complex 
structure on M. And let L be a K-prequantum line bundle over (M, u>, J). Since 
we do not impose a compatibility condition between J and u>, the almost complex 
structure does not descend to the symplectic quotients in general. Nevertheless 
we prove in this section that the Spin c prequantization defined by the data (L, J) 
induces a Spin c prequantization on the symplectic quotients M^ +Pc . 

Let y be the subset $ _1 (interior(t+)). When y ^ 0, the Principal-cross-section 
Theorem tells us that y is a Hamiltonian T-submanifold of M, with moment map 
the restriction of $ to J 7 @ • 

Lemma 4.9. If the infinitesimal stabilizers for the K-action on M are Abelian, 
the symplectic slice y is not empty. 
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Proof. There exists a unique relatively open face r of the Weyl chamber t2_ such 
that $(M) n r is dense in $(M) n t+. The face t is called the principal face of 
(AI, $) pq| . All points in the open face r have the same connected centralizer K T . 
The Principal-cross-section Theorem tells us that y T :— $ _1 (t) is a Hamiltonian 
i4T T -manifold, where [K T ,K T ] acts trivially p(| . Here we have assumed that the 
subalgebras t m := {X £ t, XM(m) = 0}, m G M, are Abelian. Hence [t T , t T ] C t m 
for every m £ y T , and this imposes [t T ,t T ] = 0. Therefore the subgroup K T is 
Abelian, and this is the case only if r is the interior of the Weyl chamber. □ 

For the remaining of this section, we assume that y ^ 0, so that the relative 
interior A° of the moment polyhedron is a dense subset of &(y). On M, we have 
the orientation o(J) defined by the almost complex structure and the orientation 
o(uj) defined by the symplcctic form. We denote their 'quotient' by e = ±1. On 
the symplectic quotients we will have also two orientations, one induces by u), and 
the other induces by J, with the same 'quotient' e. 

Proposition 4.10. The almost complex structure J induces 

i) an orientation o{y) on y , and 

ii) a T-equivariant Spin c structure on (y,o(y)) with canonical line bundle 
detc(TM|;y)<g)C_2p c . 

Proof. On y, we have the decomposition TM\y — Ty® [t/t], where [t/t] denotes 
the trivial bundle y x t/t corresponding of the subspace of TM\y formed by the 
vector fields generated by the infinitesimal action of t/t. The choice of the Weyl 
chamber induces a complex structure on t/t, and hence an orientation o([t/t]). 
This orientation can be also defined by a symplectic form of the type uj(/ t (X, Y) = 
(£, [X, Y]), where £ belongs to the interior tl. Let o{y) be the orientation on y 
defined by o{J)\y — o(y)o({£/t}). On y, we have also the orientation o(u)y) defined 
by the symplectic form wy. Note that if o( J) = e o(ui), we have also o{y) = e o{usy). 

Le t P := Spin2„ x Un Pu(TAf) be the Spin c structure on M induced by J (see 
( [f.33| )). When restricted to y, P\y defines a Spin c structure on the bundle Ty © 
[t/t]. Let q be a T-invariant Riemannian structure on T3^ © [t/t] such that T3- 7 is 



orthogonal with [t/t], and q equals the Killing form on [t/t]. Following Remark 4.4 , 
P\y induces a Spin c structure P' on (Ty © [t/t],g), with the same canonical line 
bundle L = det c (TM| y ). Since the S0 2fc x Urprincipal bundle Pso(T^) x U(t/t) is 
a reduction^ of the S02 n principal bundle Pso(TiVffi[t/t]), we have the commutative 
diagram 



(4.34) Q Pso(T^) x U(t/t) x P y (L) 

P' >■ Pso(T^ [t/t]) x Pu(L) , 

where Q is a (?/ c )~ 1 (S02fc x U;) ~ Spin^j, x U/-principal bundle. Finally we see that 
Q' = Q/U/ isaSpin c structure on T^. Since (U(t/t) x Pu(L))/U/ ~ Pu(L®C_ 2p J, 
the corresponding canonical line bundle is L' = L ® C_2 Pc • □ 

Let Aff(A) be the affine subspace generated by moment polyhedron A, and let 
A be the subspace of t* generated by {m — n | m,n € A}. Let Ta the subtorus 

5 Here 2n = dimM, 2k = dim^ and 21 = dim(t/t), so n = k + I. 
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of T with Lie algebra tA equal to the orthogonal (for the duality) of A. It is not 
difficult to see that Ta corresponds to the connected component of the principal 
stabilizer for the T-action on y. 

Here we consider the symplectic quotient := $ _1 (£)/T for generic quasi- 



regular values £ £ A° (see Definition 2^3). For such £, the fiber <E> *(£) is a smooth 



submanifold of M, with a locally free action of T/Ta, and with a tubular neigh- 
borhood equivariantly diffeomorphic to x A. Recall that Mj inherits a 
canonical symplectic form W£. 

Proposition 4.11. Let /i e such that fi = p + p c belongs to A. Let L be 
a n-prequantum line bundle. For every generic quasi-regular value £ € A°, the 
Spin c structures ony, when twisted by L|y<g)C_ M; induces a Spin c structure on the 
reduced space :— <I> _1 (£)/T with canonical line bundle (£2u>|$-i(f) ©C_2/i)/T. 
Here we have two choices for the orientations : o(Af^) induced by o(y), and o(wj) 
defined by the symplectic form uj^. They are related by o(Mg) = eo(w^). 

Remark 4.12. The preceding Proposition will be used 

i) when £ = p, + p c is a generic quasi-regular value of<&: the symplectic quotient 
(M )Ji+Pc , cj m+Pc ) is then Spin c prequantized. Or 

ii) for general p + p c G A. One takes then £ generic quasi-regular close enough 
to ii + p c . 

Proof of the Proposition. Let £ e A° be a generic quasi-regular value of $, and 
Z := $~ x (£). This is a submanifold of y with a trivial action of Ta and a locally 
free action of T/T\. We denote the quotient map by it : Z — > Mj. We identify 
7r*(TMf) with the orthogonal complement (with respect to a Riemannian metric) 
of the trivial bundle [t/ Ia] formed by the vector fields generated by the infinitesimal 
action of t/tA- On the other hand the tangent bundle Ty, when restricted to Z, 
decomposes as = TZ © [A], so we have 

Ty\ z = n*(TM 6 ) © [t/t A ] © [A] 
(4.35) = 7r*(TM e ) © [t/t A ® C] , 

with the convention t/tA = t/tA <8>iR and A = t/tA®K- Since t/tA <8>C is canonically 
oriented by the complex multiplication by i, the orientation o(y) determines an 



orientation o(M^) on TMj through (4.35) 



Now we proceed like the proof of Proposition 4.11. Let Q' be the Spin c structure 



on y introduced in Proposition 4.11, and let Q M be Q' twisted by the line bundle 
L\y <g> C_ M : its canonical line bundle is detc(TM)|^ ® C_2 Pc ® (T|y ® C_ M ) 2 = 
L 2 J\y O C_ 2 p. The S0 2 fc' x ^-principal bundle P so (7r*(TM c )) x U(t/t A <S> C) is 
a reduction^ of the S0 2 fc principal bundle P so (7r*(TM ? ) © [t/tA ® C]); we have the 
commutative diagram 

(4.36) Q" Pso(7r*(TM c )) x U(t/t A ® C) x Pu(L|z) 

Q/|z P S o(7T*(TM 4 ) © [t/t A ® C]) x Pu(LU) , 



6 Here 2fc = dim^, 2k' = dim A/ f and i' = dim(t/t A ), so k = k' + V 
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where L = L 2u \y ® C_ 2 /i. Here Q" is a (jfJ-^SCW x U//) ~ Spin^., x Uj/- 
principal bundle. The Kostant formula (2.1) tells us that the action of Ta is trivial 
on li\z, since £ — p G A. Thus the action of Ta is trivial on Q". Finally we see 
that = Q"/ (Uj/ x T) is a Spin c structure on Mj with canonical line bundle 



2u\Z 



□ 



4.3. Definition of Q(M P + Pc ). First we give three different ways to define the 
quantity Q(M M +p c ) G Z for any p G Al. The compatibility of thes e different defi- 
nitions proves Theorem 4.f and the 'hard part' of Proposition 2.4 simultaneously. 
First of all Q(M M+Po ) = if p + p c £ A. 
Mrst definition. 



$-\n+p c )/T 

is a symplectic orbifold. We know from Proposition |4.f l| that M p+Pc inherits 



If p + p c G A° is a generic quasi regular value of <!>, M, 



Spin c -structures, with the same canonical line bundle (i2w|$- 1 (/i) <8> C-2 P )/T, for 
the two choices of orientation o(Af M+Pc ) and o(o; / _ 1+(9e ). We denote the index of 
the Spin c Dirac operator associated to the Spin c structure on (M p+Po ,o(uj p -\- Pa )) 
by Q(M ti+Pi: ) G 1 and the index of the Spin c Dirac operator associated to the 
Spin c structure on (M li+Pc , o(-M^ +Pc )) by Q(M p+Pa ,o(M p+Pa )). Since o(M^ +p J = 
eo(^ +(0 J, we have Q(M^ +p J = e Q(M M+(0o , o(M M+p J). 
Second definition. 

We can also define Q(M p+Pc ) by shift 'desingularization' as follows. If p + 
p c G A, one considers generic quasi regular values £ G A°, close enough to p + 

$ _1 (£)/T inherits a Spin c structure, with 
(8 C_ 2A )/T. Then we set Q(M M+P J := Q(M{), 
where the RHS is the index of the Spin c Dirac operator associated to the Spin c 
structure on (M^,o(u>^)). If we take the orientation o(M^) induced by o(y) we 
have another index Q(M^,o(M^)) = e Q(AI^). Here one has to show that these 
quantities does not depend on the choice of £ when £ is close enough to p + p c . We 
will see that Q(M fl+Pc ) = when p + p c £ A°. 
Third definition. 

We can use the characterization of the multiplicity m AI (L) given in Lemma 



p c . Following Proposition 4. II, 
canonical line bundle (L^ 



4.2| . The number Q(M p+Pc ) is the multiplicity of the trivial representation in 



eRR (M x C>/\L® C hAl] ). 

We have to show the compatibility of these definitions, that is 

(4.37) ifp + p c eA°: \rR (M x W, L <g> C[_ m] )| * = Q(M £ , o(AQ)) 



for any generic quasi regular value £ G A° close enough to p + p c - And 



(4.38) 



if p + p c £ A° : RR (M x £>A, L 



= . 



We have proved already (Lemma |J) that [RR a (M x 0^,L ® Cj..^)]* = if 
p + p c ^ A. 



We work now with a fixed element p G A^ such that p = p + p c be- 
longs to A. During the remaining part of this section, y will denote 
a small T-invariant open neighborhood of $ _1 (p + p c ) in the symplectic 
slice $ (interior (t*j_)). 
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We will check in Subsection 4.5, that the functions II $ 



fx || 2 and 



have compact critical set on y when £ € Aff(A) is close enough to jx. Since the 
manifold (y,o(y)) carries a T-invariant Spin c -structure, we consider the localized 

T T I ~~1 I 1 

maps Q$_j 1 (y, — ) and Q^>_^(y, — ) (see Definition t4.7|) . The proof of ( |4.37[ ) and 
is divided into two steps. We first relate the maps RR (M x O^, — ) and 
through the induction map 



(4.39) Ind* : £r°°(r) — > C-°°{K) K . 

Here C~°°(T), C~°°(K) denote respectively the set of generalized functions on T 
and K, and the K invariants are taken with the conjugation action. The map 
Ind T is defined as follows : for e C~°°(T), we have J K Ind r (<fi)(k)f(k)dk = 
It mf\ T {t)dt, for every / e C°°(*T)* 

Proposition 4.13. Let E and F be respectively K-equivariant complex vector bun- 
dles over M and . We have the following equality 



RR (M xOv,EMF) = Ind T Q^Jy, E\y <8> F| g 



in R °° (K) . It gives in particular that 



RR (M x OP-,E®F) 



K 



Q*-u(y,E\y®F\ s ) 



i T 



After we compute the map Q^_^{y, — ) by making the shift JX — ► £. 

Proposition 4.14. Suppose £ E Aff(A) is close enough to p. Then 
i) the maps Q^_n(y^ — ) Q^-^J 7 , — ) are eguaZ, 



uj if furthermore £ £ A° is a generic quasi-regular value of we get 



and if H A, [Q^CV,^ 



= fi(M c ,o(M t )) 
0. 



Finally, if £ € Aff(A) is close enough to ft, Propositions 4.13 and 4.14 give 



(4.40) RR Q (M xO>+,L® C^) 



A" 



Q*^(y,L\y®c^) 

Ql- e (y,L\y®C^) 



If /i + p c e A°, we choose £ € A° clo se to p + p c : in this case ( 4.37 ) follows from 
( |l.40| ) and the point ii) of Proposit ion 4.14 . If p + p c ^ A° , we choose £ close to 
fi + p c and not in A: in this case (4.38) follows from (4.40) and the point Hi) of 
Proposition 4.14. 



Propositions 4.13 and 4.14 are proved in the next subsections. 



4.4. Proof of Proposition 4.13. The induction formula of Proposition 4. IS is 
essentially identical to the one we proved in |33|. The main difference is that the 
almost complex structure is not assumed to be compatible with the symplectic 
structure. 

We identify the coadjoint orbit with K/T. Let Ti^ be the Hamiltonian 

L Here y denotes a small 



vector field of the function 



$ A || 2 : M x K/T 
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neighborhood of <I> in the symplectic slice $ 1 (interior (t2_)) such that the open 
subset U := (K x T y) x K/T is a neighborhood of $^(0) = K ■ X {e}) 

which verifies U n {W 1 = 0} = ^(O). 

From Definition |3.8| , the localized Riemann-Roch character RR (M x K/T, — ) 
is computed by means of the Thorn class Thom£*(W) G Kjf(TjfW). On the 
other hand, the localized map Q*_«(y, — ) is computed by means of the class 



S-ThomJ" V(y) e K T (T T 3^) (see Definition f4.7|). Proposition |4.13| will follow from 



a simple relation between these two transversally elliptic symbols. 

First, we consider the isomorphism <p : U — > W, <j>([k; y], [h]) = [k; [k~ x h], y], 
where W := K X T (K/T x y). Let 0* : K K (T K U') -> Kjf(T K W) be the induced 
isomorphism. Then one considers the inclusion i : T c — *■ if which induces an 
isomo rphism j* : K T (T T ( J RT/T x y)) -> K K (T K W') (sec § g). Let j : ^ ^ 
if/T x JV be the T-invariant inclusion map defined by j(y) := (e, y). We have then 



a pushforward map j\ : (Tj^) 

:= (f>* o z» o ji 



> K T (T T (K/T xj)). Finally we get a map 
K T (T T y) — » Kj^Txtt) , 



such that Index^ (6 (cr)) = Ind T (Index^(cr)) for every cr G K T (T T J^) (see Section 
3 in El). 



Proposition 4.13 is an immediate consequence of the following 

Lemma 4.15. We have the equality 

9 (S-Thom*T A (y)) = Thorn*/' (W) . 

Proof. Let 5 be the bundle of spinors on K Xt y. S = P Xs P i n j A 2 fc, where 
P — * Pso(T(A" x T y)) x P u(L) is the Spin c structure induced by the complex 
structure. From Proposition 4.10, we have the reductions 



(4.41) 



Q 



PsoTO x U(t/t) X Pu(L|; 



■Pso(Ty©[«/t])xPu(L|y) 



P »■ Pso(T(A- x T y)) x Pu(L) . 

Here Q/Ui is the induced Spin c -structure on y. Let us denote by p : T(K x^y) — > 
A x T y p : Ty -> y and p K/T : T(K/T) -> A/T the canonical projections. 
Using ( |4.41 ), we see that 

p*S = (A x TP ;5(^)) ® j£ /r A C T(K/T) , 

where 5(3^) is the spinor bundle on 3^ Hence we get the decomposition 

S-Thom A -(A' x T y) = Thom K (K/T) K x T S-Thom T (y) . 

The transversally elliptic symbol Thorn*/ 1 (hi ) is equal to 



Thorny (K/T) Thorny (K/T) K x T S-Thom T (^) 



deformed by Ti^ 
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hence a\ :— (<fi 1 )*Thom K f ' (U) is equal to 

Thorny (K/T) K x T f ThoniT (KjT) S-Thom T (y) 



deformed by 7i' 



where H = ^(H 11 ). 

Using the decomposition TW ~ K x T (t/t© if x T (t/i)®Ty), a small computa- 
tion gives H'(m) = prt/ t (hfl) +R(m) +Hp(y) + S(m) for m = [k;[h],y] G 14', where[] 
R(m) G t/t and S(m) G T y 3^ vanishes when m G if x T ({e} x J 7 ), i.e. when [h] = e. 
Here Hp is the Hamiltonian vector field of the function || $ — ft, || 2 : y — > M. 

The transversally elliptic symbol <7i is equal to the exterior product 

01 (m, ^ + 6 + ») = c(a - Wt/i{hp)) c(f 2 - i?(m)) c(« - W p - 5(m)) , 

with ^ G t/t, 6 G t/t, and u G T^. 

Now, we simplify the symbol <T\ without changing its if-theoretic class. Since 
Char(ai) H TkU' = if Xt ({e} x J), wc transform u\ through the if -invariant 
diffeomorphism h = e x from a neighborhood of in t/t to a neighborhood of e in 
if/T. That gives cr 2 G K K (T K (K x T {t/t x y))) defined by 

(j 2 ([/c;X,y],ei+6+«) = 

c(& - pr t/t (e x /2)) c(f 2 - i?(m)) c(« — Hp, — S(m)) . 
Now trivial homotopies link cr 2 with the symbol 

03([fc,X,y],fi+e 2 + v) = c(fi - [X,A])0c(6)0c(i;-W A ) , 

where we have removed the terms R(m) and S(m), and where we have replaced 
pr t / i {e x jl) = [X,p\ + o([X,p]) by the term [X, fit]. Now we see that 03 = i*{a±) 
where the symbol 04 G ifr(TV(t/t x 3-0) is defined by 

(74(X,y;& + v) = c(-[X,£])0c(f 2 )0c(u- W A ) . 

So 04 is equal to the exterior product of (y, v) — > c{v—Hp), which is S-Thom* _ ' i (3 7 ), 
with the transversally elliptic symbol on t/t: (X, f 2 ) — > c (— [A', A]) © c (£2)- But the 
if -theoretic class of this former symbol is equal to fcj(C), where : {0} t/t (see 
subsection 5.1 in This shows that 

ct 4 = fci(C) S-Thom^CV) = j,(S-Thom*~' I (y)) . 

□ 



4.5. Proof of Proposition 4.14. In this subsection, fi = \i + p c is fixed, and 
is assumed to belong to A. The induced moment map on the symplectic slice 
$ -1 (Interior(t+)) is still denoted by Let r > be the smallest non zero critical 
value of || $ -p, ||, and let y = $- x {f G Aff(A), || f - ft ||< §}. 

For £ G Aff(A), we consider f t = tf + (1 - t)p,, < t < 1. If one shows 
that there exists a compact subset K C J such that Cr(|| $ — f t || 2 ) n J 7 C K, 
the family S-Thom* - ^' (y) , < t < 1, defines then a homotopy of transver- 
sally elliptic symbols between S-Thom* - ' 1 ^) and S-Thom* - '* ( y) . It shows that 

T T 

Q$,-p{y, ~) and Q <s? _ i {y, -) are equal. 

We describe now Cr(|| $ — ft || 2 ) n J 7 using a parametrization introduced in 



30 1 [Section 6]. Let B be the collection of affine subspaces of t* generated by the 



'A small computation shows that R(m) = pr t / t (h 1 (prt(h/i) — $(?/))), and S(m) = [p 
prt{hp)]y(y). 
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image under <I> of submanifolds Z of the following type: Z is a connected component 
of y H which intersects 4> _1 (/1), H being a subgroup of T. The set B is finite since 
is compact and thus has a finite number of stabilizers for the T action. Note 
that B is reduced to Aff(A) if fi is a generic quasi regular value of <£>. For A G B, we 
denote by , A) the orthogonal projection on A. Let = {/3(£, A) — £ | A € 2?}. 
Like in |l| [Section 4.3], we see that 

(4.42) Cr(|| $-e|| 2 )ny= |J (yns-^ + O) 

if || £ - £ ll< I- If wc takc £ : = e Aff A, | £ - £ ||< §}, we have 



Cr(|| $ - £ || 2 ) n y C /C for || £ - /2 ||< §. Thus point i) of Proposition is 
proved. 

Now we fix £ 6 Aff (A) close enough to /i. And for each /3 € B^, we denote by 
Qp(y, — ) the map localized near y@ n < i )_1 (/3 + £)■ The excision property tells us, 



like in ( |3.14| ), that 

Note that e B^ if and only if ^ 0. Point iii) of Proposition |4.14| will follow 



from the following 

Lemma 4.16. Let £ G Aff(A) c/ose enough to fl, and let (3 be a non-zero element 
o/% Then[Q T {y,L\y®C)} T = 0. ffence [G»_ 6 (3>, £|y ® C_ M )] T = 0, if ^ A. 



For the point ii) of Proposition 4.14, we also need the 



Lemma 4.17. If £ 6 A° is a generic guasi regular value of we Ziawe 
[Go C>>, Lb ® C^)] T = C(M 6 o(Mg)). 



Other versions of Lemmas 4.17 and 4.16 are already known : in the Spin-case 
for an 5 1 -action by Vergne |42|, and by the author [[33) when the Spin c -structure 
comes from an almost complex structure. 

We review briefly the arguments, since they work in the same way. We consider 



the Spin c structure on y defined in Proposition 4.10, that we twist by the line 
bundle L\y<g>C^^ : it defines a Spin c structure Q M on y with canonical line bundle 
L M := L2u> &> C_2#. We consider then the symbol S-Thom*~ ? (J^) constructed with 
0/ (see Definition $~7\). For (3 <E B s , the term Q^^LlyOC^) is by definition the 



T-index of S-Thom*"^)!^ , where U 13 is a sufficiently small open neighborhood 
of yP n$- 1 (p + £) in y. 



Proof of Lemma 4-1% A neighborhood U° of Z := $ x (£) is diffeomorphic to a 



neighborhood of Z in Z x A, where $ — £ : Z x A — > A is the projection to the 
second factor. Let pr : Z x A — > Z be the projection to the first factor. We still 
denote by Q M the Spin c -structure on Z x A equal to pr * ( Q M | z ) ■ We easily show that 
Q T p (y, L\y ® is equal to the T-index of a z = S-Thom*^(Z x A). Let Q" be 
the reduction of Q^\z introduced in ( 4.36 ). Since Q^\z — Spin!^ X( Spin c /X u 2i /)Q") 



the bundle of spinors S over Z x A decomposes as 
S = pr* U"S{M i ) ®Zx A(t/t A 
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f){Z x A) 
The map 



Here S(M{) is the bundle of spinors on induces by the Spin c -structure Q" /V21', 
and 7r : Z — > is the quotient map. Inside the trivial bundle Z x (t/tA <8 C), 
we have identified Z x (t/tA ® with the subspace of TZ formed by the vector 
fields generated by the infinitesimal action of t/tA, and Z x (t/tA <£> K) with Z x 
A C T(Z x A)| z . For (z, /) S Z x A, let us decompose v £ T (j 
as u = vi + X + iY, where v x G tt*(TM 5 ), and e t/t A ® C 

c.z(£, /; v\ + X + iY) acts on S(M^) Z ® A(t/tA ® C) as the product 

c,(«i)0c(x + i(r-/)) , 

which is homotopic^j to the transversally elliptic symbol 

Cz(ui)0c(/ + iX) . 

So we have proved that az = j\ ° 7r*(S-Thom(M^)), where j< : Kt{TtZ) — > 
i^r(TT(Z x A)) is induced by the inclusion j : Z ^ 2 x A. The last equal- 
ity finishes the proof (see j33) [Section 6.1]). 



Proof of Lemma J^Ab. The equality [Qg(~y,L\ 



comes from a 



localization formula on the submanifold y@ for the map Q /3 (y,—) (see [|3j| j42||). 
The normal bundle A/" of 3^ in y carries a complex structure J_\f on the fibers such 
that each T^-weight a on (Af,Jj\f) satisfies (a, /3) > 0. The principal bundle Q M , 
when restricted to y@ admits the reduction 



(4.43) Q' 



PsoW) x Pu(AA) x Pu(L|^) 



•Pso(T^e^) xPu(L'V) 



Hence Q' 3 := Q'/U(/) is a Spin c -structure on y 13 with canonical line bundle equal 
to IT 3 :=ir\yf> <g) (det A/) -1 = L^ly/s ® C_ 2A ® (detA") -1 - Let QjQ" 3 ,-) be the 
map defined by Q' 3 and localized near <& -1 (/3 + £) n y@ by <E> — £. Following the 
argument of Q [Section 6] one obtains 

Q T fj (y,L\y®c^) = (-i) l Y,Q T 0(y ,fetM®s k (Af)) , 

fcGN 

where S k (AT) is the k-th symmetric product of A/", and I — rankcA/". Thus, it is 
sufficient to prove that [Ql (y , det A/" ® 5 fc (A/"))] T = for every fc e N. For this 
purpose, we use Lemma [4.8[ Let a be the T^-weight on det Af. From the Kostant 



formula (2.1), the T^-weight on L 2ul \yf-t is equal to 2(/3 + £). Hence any T^-weight 
7 on det AT® £ fe (Af) (IL 3 ) 1 / 2 is of the form 

7 = /3 + £ - A + ^ + * 

where (5 is a T^-weight on S k (J\f). So (7, = + + | (a, £) + (<S,/3). But 

the T^-weights on A/" are 'positive' for j3, so (a, /?) > and (5, j3) > 0. On the other 
hand, (3 + £ = /?(£, A) is the orthogonal projection of £ on some affine subspace 
A C tl which contains /Et: hence (/3 + £ — /2, /3) = 0. This proves that (7, /3) > 0. □ 



8 Seo ||] [Section 6.1]. 
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5. Quantization and the discrete series 



In this section we apply Theorem 4.1 to the coadjoint orbits that parametrize 



the discrete series of a real, connected, semi-simple Lie group G, with finite center. 
Nice references on the subject of 'the discrete series' are |3(], M|. 

Let if be a maximal compact subgroup of G, and T be a maximal torus in K. 
For the remainder of this section, we assume that T is a Cartan subgroup of G. 
The discrete series of G is then non-empty and is parametrized by a subset Gd in 
the dual t* of the Lie algebra of T Jjjj. 

Let us fix some notation. Let 5R C c SK c A* be respectively the set of (real) 
roots for the action of T on t © C and g © C. We choose a system of positive roots 
9t + for 9\ c , we denote by t* the corresponding Weyl chamber, and we let p c be 
half the sum of the elements of 91+ . We denote by B the Killing form on g. It 
induces a scalar product (denoted by (—,—)) on t, and then on t*. An element 
A € t* is called regular if (A, a) ^ for every a £ *H, or equivalently, if the stabilizer 
subgroup of A in G is T. Given a system of positive roots 9\ + for SH, consider the 
subset A* + I a °f t*- This does not depend on the choice of and we 

denote it by A* Q. 

The discrete series of G are parametrized by 

(5.44) G d := { A e t* , A regular } n A; n t+ . 

When G = K is compact, the set Gd equals K* + + p c , and it parametrizes the set of 
irreducible representations of K. Harish-Chandra has associated to any A € Gd an 
invariant eigendistribution on G, denoted by 0a, which is shown to be the global 
trace of an irreducible, square integrable, unitary representation of G. 

On the other hand we associate to A S Gd, the regular coadjoint orbit M := G- A. 
It is a symplectic manifold with a Hamiltonian action of K . Since the vectors 
Xm, X S g, span the tangent space at every £ £ M, the symplectic 2-form is 
determined by 

w(X M ,Y M )t = (Z, [X,Y]) . 

The corresponding moment map $ : M — * t* for the if-action is the composition 
of the inclusion z : M g* with the projection g* — ► t*. The vector A determines 
a choice fH +,A of positive roots for the T-action on g ® C : a G 9l +,A (a, A) > 
0. We recall now how the choice of 9l +,A determines a complex structure on M. 
First take the decomposition g<g)C = t<g)C© SaesnBa where Q a := {v e g ® 
C | exp(A).t; = e^"' X ^w for any A £ t}. It gives the following T-equivariant 
decomposition of the complexified tangent space of M at A : 

T A M (g)C=^g Q =n©n, 

with n = SaeSR+ A Q - ^ e have then a T-equivariant isomorphism X : T\M — > n 
equal to the composition of the inclusion T\M T^M ® C with the projection 
n © n — > n. The T-equivariant complex structure J\ on T^M is determined by 
the relation I(J\v) — iX{v). Hence, the set of real infinitesimal weights for the 
T-action on (T\M, J\) is 9l +:A . Since M is a homogeneous space, J\ defines an 
invariant almost complex structure J on M, which is in fact integrable. Through 
the isomorphism M = G/T, the canonical line bundle k = detc(TAf) -1 is equal to 
k = G x T C-2 P with p=\ J2a£9\+.* a - 
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If A € Gd, then A — p is a weight, and 
(5.45) L:=Gx T C A - P ^G/T 

is a K-prequantum line bundle over (M, to, J). We have shown in 0), that 
Cr(|| $ || 2 ) is compact, equal to the if -orbit K ■ A. Then the generalized Riemann- 
Roch character RR^ (M, — ) is well defined (see Definition 3.2). The main result of 
this section is the following 



Theorem 5.1. We have the following equality of tempered distributions on K 

dimfG / K) K 

®\\k = (-1) — 5 — RR*(G-\,L) , 
where Q\\k is the restriction of the eigendistribution Q\ to the subgroup K. 



The proof of Theorem 5.1 is given in S ubsection 5.2 . It uses the Blattner formulas 
in an essential wa y (se e Subsection 5.1). 



to 



With Theorem 5.1 at our disposal we can exploit the result of Theorem 4.1 
compute the if -multiplicities, m At (A) G N, of Q\\k in term of the reduced spaces. 
By definition we have 



(5.46) 



Qx\k = 



The momen t m ap $ : G ■ A — > 6* is proper since the G ■ A is closed in g* [p2| . We 
show (Lemma 5.5 ) that the moment polyhedron A = <&(G • A) n t5_ is of dimension 
dimT. Thus on the relative interior A° of the moment polyhedron, the notions of 
generic quasi-regular values and regular values coincide : they concern the elements 
£ G A° such that < I ) ~ 1 (£) is a smooth submanifold with a locally free action of T. 
We have shown (Subsection [Q| ) how to define the quantity Q((G ■ A) AI+Pc ) G Z 
as the index of a suitable Spin c Dirac operator on <!> -1 (£)/T, where £ G A° is a 
regular value of <& close enough to fi + p c . 



Proposition 5.2. For every fj, £ A* 



>e ho 



m M (A) = Q((G-A) M+p J . 

in particular m M (A) = if p + p c does not belong to the relative interior of the 
moment polyhedron A. 



Proof. A small check of orientations shows that e = (— 1) 2 ( thus this 



proposition follows from Theorems 4.1 and 5.1 if one checks that the following 
holds: (G • A, $) satisfies Assumption 3.6, and the infinitesimal if-stabilizers are 
Abelian. The first point will be handled in Subsection 5.3. The second point is 
obvious since M = G/T: all the G-stabilizers are conjugate to T, so all the K- 
stabilizers are Abelian. □ 
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5.1. Blattner formulas. In this section, we fix A £ Gd- Let x be the system 
of positive roots defined A: a £ 9\ + ' X (a, A) > 0. Then <K+ C and 

P = I Eqgk+. a a decomposes in p = p c + p n where p n = \ S a eK+ a ancl = 

Let "P : A* > N be the partition function associated to the set : for p £ A* , 
V(p) is the number of distinct ways we can write p = J2 a £m + with k a £ N 
for all a. The following Theorem is known as the Blattner formulas and was first 
proved by Hecht and Schmid [^0| . 

Theorem 5.3. For p £ A!j_, we have 

nv(A)= ^(-irp(^(M + Pc)-(MA+Pc)) , 

wheren p\ := A — p c + p n . Here W is the Weyl group of (K, T). 



Using Theorem 5.3, we can describe 0a \k through the holomorphic induction 
map Hoi* : i?~°°(T) -> i?" 00 ^). Recall that Hoi* is characterized by the 

K 

following properties: i) Hol T (t^) — f° r every dominant weight p £ A^; ii) 

Hol^(t wo ^) = (-l)"'Hol^(^) for every w £ W and p £ A*; hi) Hol*(^) = if 
W o p n A+ = 0. Using these properties we have 

(5.4?) Yl WHoC(f) = J2 [ H (-ir^°M) 

for every map 1Z : A* — > Z. 

For a weight a € A*, with (A, a) ^ 0, let us denote the oriented inverse of (1 — t a ) 
in the following way 

f ka 



E fceN * > . if (A,«)>0 
ken ' 



K I -*- a E fceN ^ fc % if (A,a)<0 



Let ^4 = {ai,-- - be a set of weights with (A, ttj) 7^ 0, Mi. We denote by 
A + = {eiai, • • ■ ,£iai} the corresponding set of polarized weights: = ±1 and 
(A, £i«i) > for all i. The product n QSy ![[l — i"]^ 1 is well defined in R~°°(T), and 
is denoted by [n a6 ^(l — i")]^ 1 . A small computation shows that 



1 = (-i) r t^[n Qeyl+ (i-r)' 



-1 



(5.48) = (-lft-T £ ^+(m)^ ■ 

MSA* 

Here 7^+ : A* 1— > N is the partition function associated to ^4 + , 7 = J2(x a )<o a > 
and r = (j{a € A, (A, a) < 0}. This notation is compatible with the one we used 
in |53| [Section 5]. If V is a complex T- vector space where the subspace fixed by 
A is reduced to {0}, then A'U £ R{T) admits a polarized inverse [AJU]^ 1 = 
[naeSR(u)(l — ^ q )]a ' where ?R(V) is the set of real infinitesimal T-weights on V. 



®We shall note that fi\ G (see [Q, section 5). 



3(5 
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Lemma 5.4. We have the following equality in R 00 (K) 

1 -1 



&x\k = Hol f 



n 



Proof. Let G i? 00 (X) be the RHS in the equality of the Lemma. From 
( ED , we have 9 = £ MeA , W Hoi" ) = £^ A , - Ma) Hoi* ). If we 

use now (5.47), we see that multiplicity of 9 relative to the highest weight p G 
is J2 weW (—l) w P(w(fi + p c ) — (p\ + pc))- From Theorem 5.3 we conclude that 
□ 



9 



\\K 



9. 



5.2. Proof of Theorem 5.1. In Lemma 5.4 we have used the Blattner formulas 

— . — K 1 — 1 

to write 9a|_k" in term of the holomorphic induction map Hol r . Theorem 5.1 is 

then proved if one shows that RR*(G-\,L) = (-l) r Hol* (f> [H aem + (1 - t a )]~ 1 ), 
with p\ ~ X — p c + p n , and r = idim(G/if). More generally, we show in this 
section that for any if-equivariant vector bundle V — > G ■ A 

(5.49) rrI(g-x,v) = (-i) r HoC(y A .t 2 ^.[n QG5l +(i-t Q )]~ 1 ) , 

where Vx G i£(T) is the fiber of V at A. 

First we recall why Cr(|| <E> || 2 ) = K ■ A in M := G ■ A (see |}2| for the general case 
of closed coadjoint orbits). 9ne can work with an adjoint orbit M := G ■ A through 
the G-identification g* ~ g given by the Killing form; then $ : M — ► I is just 
the restriction on M of the (orthogonal) projection g — > J. Let p be the orthogonal 
complement of t in g. Every m G M decomposes as to = x m +y mj with x m = $(m) 
and y m G p. The Hamiltonian vector field of ^- || $ |j 2 is W m = [a: m ,m] = [x m , y m ] 
(see[T§). Thus 

Cr(|| $ || 2 ) = {H = 0} = {to G M, [x m ,y m ] = 0} . 

Now, since A is elliptic, every to G M is also elliptic. If to G Cr(|| <E> |j 2 ), [m, x m ] = 
and elliptic, hence y m = m — x m is elliptic and so is equal to 0. Finally 

Cr(|| $ || 2 ) = G- Ane = x-A. 



According to Definition 3.2, the computation of RR^ (G ■ A, L) holds on a small 



if-invariant neighborhood of K ■ A of G • A. Our model for the computation will be 

M := K x T p 

endowed with the canonical if-action. The tangent bundle TM is isomorphic to 
K Xt (t© Tp) where r is the T-invariant complement of t in {!. One has a symplectic 
form O on M defined by f2 m (V,V) = (A, [X, X'] + [v, v']}. Here m = [k,x] G Kx T p, 
and V = [k, x; X + v], X' = [k, x; X' + v'] are two tangent vectors, with X, X' G t 
and v,v' G p. A small computation shows that the if-action on (K Xj p,fl) is 
Hamiltonian with moment map $ : M — > I* defined by 

<l([fc, x]) = k ■ ^A - ^pr t « (A o ad(x) o ad(x)) 

Here ad(ai) is the adjoint action of x, and pri* '■ g* — * t* is the projection. Note 
first that the tangent space T\M and T[ lj0 ]M are canonically isomorphic to r0p. 
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Lemma 5.5. There exists a K -Hamiltonian isomorphism T : 14 ~ 14, where 14 is a 
K -invariant neighborhood of K ■ X in M, 14 is a K -invariant neighborhood of K/T 
in M, and T(A) = [1,0]. We impose furthermore that the differential of T at X is 
the identity. 

Corollary 5.6. The cone A + X) q gir + K + a coincides with A = (G • A) PI in a 
neighborhood of X. The polyhedral set A is of dimension dimT. 

Proof of the Corollary. The first assertion is an immediate consequence of Lemma 



5.5 and of the convexity Theorem [|26| . Let X a G t such that £ (X a ) = for all £ € A , 
that is a(X ) = for all a <G : X a commutes with all elements in p. Let a be 
a maximal Abelian subalgebra of p, and let £ be the set of weights for the adjoint 
action of a ong : q — X^aes 0"' where g a = {Z 6 0, [X, Z] = a(X)Z for all X e a}. 
Since [X ,a] = 0, we have [X O ,0 Q ] C Q for all a e S. But since [A Q ,p] = and 
g a fl 6 = for all a ^ 0, we see that [A Q , g a ] = for all a ^ 0. But A c belongs to 
the Abelian subalgebra go, so [X ,g Q ] = 0. We see finally that X a belongs to the 
center of q, and that implies X Q = since G has a finite center. We have proved 
that A ± =0, or equivalently A = t. □ 

Proof of Lemma |5-4 The symplectic cross-section Theorem fT^| asserts that 
the pre-image y :— <l> _1 (interior(t^_)) is a symplectic submanifold provided with a 
Hamiltonian action of T. The restriction <f>\y is the moment map for the T-action on 
y. Moreover, the set K.y is a i^-invariant neighborhood of K-X in M diffeomorphic 
to K Xt y. Since A is a fixed T-point of y, a Hamiltonian model for (3^, oj\y, &\y) 
in a neighborhood of A is (T\y, uj\, $a) where oj\ is the linear symplectic form 
of the tangent space T\M restricted to T\y, and $a : T\y — > t* is the unique 
moment map with $a(0) = A. A small computation shows that x — ► A o ad(a;) is 
an isomorphism from p to T\y, and Q\(x) = X — \prt* (A o ad(x) o ad(x)). □ 

We still denote the almost complex structure transported onW c A'x^p through 
T by J. Since gTF(A) is the identity, J[i.o] :r0p^r0pis equal to J\. Let 
7r : K x T p — > K/T, and ir^ : 14 — » K/T be the fibering maps. Remark that for 
any equivariant vector bundle V over M the vector bundle (Y -1 )* (V|w) ~» U is 



isomorphic to ^{K Xt V\). At this stage, we have according to Definition 3J2 
(5.50) RR$(G- A, V) = Indexf f Thorn* (U, J) ® tt^AT x t F a ) 



With the help of Lemma p.4| , we define now a simpler representative of the class 
defined by Thom*(W, J) in Krt(T^W). Consider the map 

A:Ax T p — > 6* 

(k, x) i — > k ■ X , 

and let A^ be the vector field on M generated A. (see (|3.8|)). Note that X^ never 
vanishes outside the zero section of K XtP- Let (— , — ) - be the Riemannian metric 
on M defined by (V, V') M = (X, X') + (v, v') for V — [k, x; X+v], V = [k, x; X'+v']. 
A small computation shows that 

(W,^fr)*=ll AmII 2 +o(II a^|| 2 ) 
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in the neighborhood of the zero section in K Xrp. Hence, if we take U small 
enough, (Ti, A^) - > on U — {zero section}, hence Thorn* (U, J) = Thom^ (U, J) 



in Kif(T^-W) (see Lemma 3.4) 



Let J be the iT-invariant almost complex structure on M, constant on the fibers 
of M — * K/T, and equal to J\ at [1,0] so that for [k,x] € K x T p, J[k,x](Y) — 
[k, x, J\(X + v)] for V — [k, x, X + v]. Since the set {A A : f = 0} = K/T is compact, 
using J and the map A, one defines the localized Thorn symbol 

Thorn- (M, J) e K K (T K M) . 

Through the canonical identification of the tangent spaces at [k,x] and [k,Q], one 
can write Jik,x] = J[k,o] = ^[fc,o] f° r an Y [&) ^1 G W. We note that J and J are 
related on hi by the homotopy J* of almost complex structures: J' fc ^ := Jjfe^a;] 
for [fc,a:] G From Lemma pO, we conclude that the localized Thorn symbols 



Thom^ (W, J) and Thom^ (M, J)|^ define the same class in 'K K {T K U) 1 thus ( |5.50D 
becomes 

(5.51) RR^iG ■ X,V) =lnde^ (Thom^{M, J) (E,tt*(K x T Vx)) . 



In order to compute ( 5.51 ), we use the induction morphism 

U : K T (T T p) — » K K (T X (K x T p)) 

defined by Atiyah in @ (see §§ [Section 3]). The map z* enjoys two properties: 
first, i* is an isomorphism and the if-index of a € Kjf(T^(if Xt p)) can be 
computed with the T-index of (i*) _1 (cr). 

Let a : p*(E + ) — > p*(E~) be a if-transversally elliptic symbol on if x-rp, where 
p : T(if x^p)— >i"TxTpis the projection, and E + ,E~ are equivariant vector 
bundles over K p. So for any [A;, a;] £ K Xj p, we have a collection of linear 
maps a([k, x. X + v]) : , — > ST ^ depending on the tangent vectors X + v. The 
symbol (i*)~ 1 (cr) is defined by 

(5.52) (w)-V)M = <7([l,i,0 + «]) : — ► £ [M for any (x,v) € Tp. 

For (j = Thorn* (M, J), the vector bundle E+ (resp. £T) is A^ dd TM (resp. 
Ajj" e "TM). Since the complex structure leaves t = t/t and p invariant one gets 

(iO -1 (Thoi4(M, J)) = Thom^(p, J A ) e/t , 

and 

(5.53) (z*)- 1 (Thom^(M, J) ® tt*(K x t Vx)) = Thorn* (p, J A ) V x A' c t/t , 

where Thorn* (p, J\) is the T-equi variant Thorn symbol on the complex vector space 
(p, J\) deformed by the constant map p — > t, x i— > A. In ( 5.53 ), our notation uses 
the structure of i?(T)-module for Kx(Trp), hence we can multiply Thom A (p, J\) 
byV x A' c t/t. 
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Theorem 4.1 of Atiyah in Q tells us that 



(5.54) 



K T (T T p) 
IndeXp 
C-°°(T) 



K K {T K M) 

Index^, 



Ind 



K 



is a commutative diagram, with M = K Xxp, and where Ind is the induction map 



(see (|4.39D). In other words, Index" f (cr) = Ind r (Index^ ((i*) _1 (<r))). With (|5_5l|), 
(|||), and ( |5^5l ), we find 

RRl (G -X,V) = Ind* (indexjf (Thorn* (p, J A )) V\ A' c t/t 
= Hoi* (indexjf (Thorn* (p, J A )) V, 

(See the Appendix in |33| for the relation Hol T (— ) = Ind T ( — 
index Indexjf (Thorn* (p, J A )) is computed in Section 5 of ]33| |: 

n -1 



A* l/t).) But the 



Indexation!* (p, J A )) = 



n 



n 



+ (1-*°) 



with r = \ dxm{G/K). Equality (|5.49|) 

in then proved. 



5.3. (G • A, $) satisfies Assumption 3.6. Let M be a regular elliptic coadjoint 
orbit for G, with the canonical Hamiltonian if-action. The goal of this section is 
to show that M satisfies Assumption 3.6 at every fi. 

Let q = t © p be the Cartan decomposition of 0. The Killing form B provides a 
G-equivariant identification — 0* and if-equivariant identifications t ~ 6*, p ~ p*. 
The Killing form B provides also a if-invariant Euclidean structure on such that 



and II X 



X\ || 2 + ||X 2 II 2 , for X = X,+X 2 



B(X,X) = -\\X 1 || 2 
with Xi S 6, X 2 G p. 

Hence we can and we shall consider M as a adjoint orbit of G: M = G ■ A where 
A 6 6 is a regular element, i.e. G A = if A is a maximal torus in K (in this section 
• means the adjoint action). The moment map $ : M — * 6 is then the restriction 
to M of the orthogonal projection t p — * t. For /i € f, we consider the map 
$ M : M x if • /i — > 6, (m, n) i-> $(m) — u. 

This section is devoted to the proof of the following 

Proposition 5.7. The set Cr(|| ^ || 2 ) of critical points of || ^ |j 2 is a compact 
subset of M x K ■ /i. More precisely, for any r > 0, there exists c{r) > such that 

Cr(|| || 2 ) C (M n e 0, || £ ll< c(r)}) X K ■ fj, , 
whenever \\ fi ||< r. 

Note that M n {£ € 0, || £ ||< c(r)} is compact, thus Proposition [T7] shows that 
M satisfies Assumption 3.6 at every /z. Let a be a maximal Abelian subalgebra of 
p, and consider the map 

: (K ■ A) x (K ■ fj,) x a -> R 
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defined by F^(m, n, X) 



e x ■ m || 2 — 2 < e x ■ m, n >. 



Proposition 5.8. For any r > 0, there exists c(r) > such that 



(to, n, X) e Cr(i^) || e x ■ m ||< c(r) , 



whenever \\ fi ||< r. 



We first show that Proposition 5.8 implies Proposition 5.7, and then we concen- 



trate on the proof of Proposition 5.. 



Proposition 5.8 => Proposition 5.1. Consider the map $ — fj, : M — ► I. 
One easily sees that Cr(|| $ M || 2 ) = if ■ (Cr(|| $ M || 2 ) n (M x {//})), and 
Cr(|| $ M || 2 ) n (M x {/x}) c Cr(|| $ - /x || 2 ) x {/i}. Thus Proposition |j is proved 
if one shows that for any r > 0, there exists c(r) > such that 

Cr(|| <I> - M f) c M n G 5) ||f ||< c(r)} , 

whenever || fi ||< r. Since the bilinear form B is G-invariant, the map m — > B(m, to) 
is constant on M, equal to — || A || 2 , and thus || $(m) || 2 = i || m || 2 4 
any m G M. Finally we have on M the equality 



A || 2 for 



$(m) - /i || 2 = i || to || 2 -2 < m, ^ > 



-est 



where est 



\ || A || 2 + || /i || 2 . If we use now the Cartan decomposition G = 
K ■ exp(p), and the fact that p = Ukenk ■ a, we see that every element M is 
of the form to = (k^ 1 e x k2) ■ A with fci,/c2 G K and X e a. It follows that 
|| $((fcj" 1 e x fc 2 ) • A) -fi || 2 = F /1 (m / ',rc, X) + cst with m' = fe 2 • A, n = k\ ■ [m. It is now 
obvious that if m = (k7_ 1 e x k 2 ) ■ A G Cr(|| || 2 ) then (fe 2 • A, fci • fi, X) G Cr(i^). 

Finally, if Proposition 5.8 holds we get || m || = | e x -to' ||< c(r). □ 



Proof of Proposition 5.1. Let (m,n, X) G Cr(F M ). Then, the identity 
£ t FK( m ,n,X + tX)\t=o = gives 



(5.55) 



< e x ■ m,e x ■ [X,m] >= 2 < e x ■ [X, m],n> 



The proof of Proposition 5.8 is then reduced to the 

Lemma 5.9. i) For any r > 0, there exists d(r) > swc/i that \\ e x ■ \X, m ] \\< 

d(r) || X || holds for every (m,n, X) G if • A x t x a satisfying ( 5.55 ) and 
II n II— r - 

ii) For any d > there exists c > 0, such that for every (m, X) G K ■ A x a, 



we /lane || e x ■ [X,m] \\<d\\X 



• to < c. 



Proof of i). Let E be the set of weights for the adjoint action of a on g: g = 
X! £ g Q , where g Q = {Z e g, [AT, Z] = a(X)Z for all X G a}. Each m G g amits a 
decomposition m = ^ Q to q , with m a G g Q , which is stable relatively to the Cartan 
involution: 



(5.56) 



9(m a ) = m— a , for every to G g . 



Suppose now that u := (m, n, X) e if • A x 6 x a satisfies ( |5.55| ). We decompose 
m G K • A into m = ^ Q m a with m a G g Q . Let E„ := {a G E, to q ^ and ± 
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a(X) > 0}. The LHS of decomposes in LHS = J2 a e 2a(X) a{X) \\ m a || 2 , 

and 

LHS = e 2tt(X) a(X) \\m a \\ 2 + J2 e 2a{X) a(X) \\ m a || 2 

> E eMX) ^Tx\\ 11 ma l|2 - R 11 x 11 E 11 m « l|2 [1] 

with R := sup a iijf |a(X)|. But 
£ e 2a ^a(X) 2 || m a || 2 = || e x ■ [X,m] || 2 - £ e 2a ^a(Xf \\ m a || 2 

> ||e^.[X,m]|| 2 -i? 2 ||X|| 2 £ ||m Q || 2 [2] 

Since a G £+ -a G E~, we have 2^ aeE - II m a || 2 < £ aeE II m " ll 2 = ll m II 2 
= || A || 2 . So, the inequalities [1] and [2] give 

(5.57) LHS > ] ^JYJ " 2 '^II^II-II A II 2 • 

Since the RHS of ( ^55| ) satisfies obviously RHS < 2 || e x ■ [X, m] \\ . \\ n || , ( ^55|) 
and ( 5.57 ) yield 

2||e^.[X,m]||.||n||> 11 ^ ^ — — i? || X || . || A || 2 . 

In other words E :=|| e -[X, m] || satisfies the polynomial inequality E 2 —2aE—b 2 < 
0, with b = R || X || . || A || and a = R \\ X \\ . \\ n ||. A direct computation gives 

|| e x .[X,m] ||<d||X|| , 

with d = R(\\ n || +VII^H 2 + II A|| 2 ). □ 

Proof of ii). Suppose that ii) does not hold. So there is a sequence (to.;, Xi) ie N 
in K ■ A x a such that || e Xi ■ [Xi,rrii] ||< d || X% | but liim^oo || e Xi ■ rrii \\ = oo. 
We write X; = tjUj with ii > and || Vi || = 1. We can assume moreover that 
Vi — ► Voo S a with || Vac \\— 1, and rrii — > moo G if • A when i — > oo. 

But TOqo G if • A is a regular element of G, and rank(G) =rank(Jf), thus 

7^ 0: there exist s a c G £ such that a (w 00 )m 00iQo ^ 
0, and then also a (v 00 )m 00i - ao ^ (see ( 5.56 )). 

On one hand the sequence e tiVi .rrii = Yl a etia ^ m ^ a diverges. Hence (ti) ie fi 
is not bounded and so can be assumed to be divergent. On the other hand 
e tiVi ■ [vi,m,i] — ^2 a e 1 ^^^ a{vi)m ita is bounded, so the sequences 
e ti±a °( Vi ^ a{vi)rrii } ± ao are also bounded. But lim^oo a(vi)mi,± ao — a (w 00 )m 00 ,± Qo 
7^ 0, hence the sequences e ti±a °^ Vi ^ are bounded. This contradicts the fact that 
lim^oo U = +oo and limi— oc a (vi) ^ 0. □ 
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